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FIELD OF THE INVENTION 

The present invention relates generally to apparatus for inspecting articles in motion and particularly to 
apparatus for sorting and grading agricultural produce. 

5 

BACKGROUND OF THE INVENTION 

In the present specification and claims, the term "sorting" is used to mean categorization of articles by 
size and/or color and the term "grading" is used to mean categorization of articles by quality and/or type. 
10 Systems for sorting and grading of apples based on computing thinness ratios for blemishes are described 

in the following two publications by Rehkugler, G. E. and Throop, J. A.: 

"Image processing algorithm for apple defect detection", Trans, of the ASAE, Vol. 32(1), pp. 267 - 272, 
1989, and 

"Apple sorting with machine vision", Trans, of the ASAE, Vol. 29(5), 1 388- 1 397, 1 986. In this reference, 
is diffuse illumination is provided by a translucent acrylic box. 

A Ph.D. dissertation by G. L Graf ("Automatic detection of surface blemishes on apples using digital image 
processing", Cornell University, 1982, available from UMI Dissertation Information Service, 300 N. Zeeb Rd. 
Ann Arbor, Michigan 48106) discloses in Fig. 4-4 a generally cylindrical diffuser and apparatus for illuminating 
the diffuser from the exterior thereof, for inspecting an apple which has been manually placed within the cyl- 
20 indrical diffuser. 

Another cylindrical diffused light system is described in Sarker, N. and R. R. Wolfe, "Computer vision based 
system for quality separation of fresh market tomatoes", Trans. ASAE, Vol. 28, pp. 1714 - 1718, 1985. The 
Sarker et al system includes mechanical apparatus for aligning tomatoes along the stem/calyx axis and a defect 
detection subsystem which employs adaptive thresholding of a gradient image. 

25 Color inspection methods for peaches in which peaches are viewed from more than one angle using mul- 

tiple sensors, a frame grabber, a CCD camera, one-sided diffuse illumination and color grading and feature 
extraction algorithms are mentioned in Miller, B. K. and Delwiche, M. J., "A color vision system for peach grad- 
ing", Trans, of the ASAE, Vol. 32(4), 1484 - 1490, 1989. 

An EO commercial development of a sorter and grader system employing solid-state CCD cameras in 

30 which blemishes are detected on fruit rolling on bicone rollers is described in A. Davenel et al, "Automatic de- 
tection of surface defects on fruit by using a vision system", J Agricultural and Engineering Research, 41, 1- 
9,1988. 

Methods for identifying bruised apple tissue using reflected light of one, two or three normalized wave- 
lengths, including computations of differences or ratios between 2 wavelengths, are discussed in B. I_ Up- 
35 church et al, "Spectrophotometric study of bruises on whole, red delicious apples". Transactions of the ASAE, 
33(2), March-April 1990. 

Upchurch etal describe various models for distinguishing bruised from nonbruised areas on Red Delicious 
apples. One such model is set forth in Equation 5 and comprises a two wavelength difference which is divided 
by a normalizing wavelength to take into account illumination changes. Upchurch et al propose to cancel out 
40 differences in reflectance levels, due to factors other than tissue condition, by division. 

United States Patent 5,085,325 to Jones et al discusses color sorting of articles and use of a camera and 
flash to image moving articles. Color analysis is performed on the basis of RGB color imaging and spherical 
color coordinates. 

United States Patent 5,012,116 to Russell discusses a system for detecting defects in diffusely illuminated 
45 bearing balls which roll along a pair of parallel rails. 

U.S. Patent 5,010,247 to Smith et al discloses a system in which objects are dropped through a viewing 
zone and are viewed by three viewers arranged along 3 mutually orthogonal axes using radiation of different 
wavelengths. 

A method for deriving information regarding convexity/concavity of an article by projecting a grid pattern 
so on the article is disclosed in N. Shrikhande and G. Stockman, "Surface orientation from a projected grid", IEEE 
Transactions on pattern analysis and machine intelligence, Vol. 11(6), June 1989. 

Attempts to detect fruit stems using image processing are reported in Wolf, R. R and Sander, W. E, "An 
algorithm for stem detection using digital image processing", Trans. ASAE, 28, pp. 641 - 644, 1984. 

U.S. Patent 4,863,041 to Bailey discloses a system for observing an article from 4 sides without imaging, 
55 using a color background which is dynamically controlled. The system is triggered as a response to intercepted 
light beams. 

U.S. Patent 5,078,258 to Van Der Shoot discloses a system which orients apples by mechanical apparatus 
and subsequently picks the apple. The system includes a color camera which identifies "red cheek" on an apple. 



2 



% t 

J; 

<L EP 0 566 397 A2 

Or 

U.S. Patent 4,940,850 to Satake discloses a system of 3 detectors which "look" at an article in vertical free 
fall through 2 spectral filters. 

U.S. Patent 4,878,582 to Codding discloses a Dichromatic sorter in which an article is seen from 3 coplanar 
5 directions, on a color background. 

U.S. Patent 4,741 ,042 to Throop et al discloses a software system for analyzing size and shape of bruises 
on fruit by creating a binary image of bruises. 

U.S. Patent 4,645,080 to Scopatz discusses a system for grading non-orienting articles. Specifically, the 
system grades oranges on the basis of information from three overhead and side sensors. 
10 U.S. Patent 4,51 5,275 to Mills et al discloses a system for processing fruit such as lemons. Polarized illu- 

mination of the fruit is provided from 4 sides and a single video camera or line scanner is employed. 

U.S. Patent 4,204,950 to Burford, Jr. discloses a grading system using four spectral bands, of which two 
are visible. 

A state of the art system for conveying fruit is marketed by Accu Pak Systems. 

15 Published PCT Application WO 91/04803 describes apparatus for weighing, sizing and defect sorting of 

fruit including one or more singulators, a conveyor for passing the fruit under a CCD array camera, means for 
rotating the fruit under the camera, an image processor including a master processor passing signals to a vision 
processr and 8 object processors which divide the captured image into image sections each representing only 
one piece of fruit, and ejectors spaced along the conveyor which eject the fruit to outfeed conveyors corre- 

20 sponding to sorting categories. 

SUMMARY OF THE INVENTION 

The present invention seeks to provide an improved system for inspecting articles such as but not limited 
25 to agricultural produce, including apples. 

According to a preferred embodiment of the present invention, a complete sorting system is provided here- 
in including a sequence of interlacing cable conveyors for conveying objects to be sorted, such as apples or 
other agricultural produce, from bulk storage at the input to the system, through the system, and along to drops 
at the output of the system. The cable conveyors are configured and arranged to handle even delicate agri- 
30 cultural produce without damage and at high speed. The produce or objects which are conveyed typically do 
not roll along the conveyors. Preferably, objects of substantially any shape can be conveyed along the system. 

There is also provided in accordance with a preferred embodiment of the present invention apparatus for 
inspecting agricultural produce having a stem and a calyx including a stem/calyx identifier for deter mining the 
locations of the stem and the calyx of the agricultural produce, and a blemish detector, cooperative with the 
35 stem/calyx detector, for detecting blemishes and avoiding false detections of the stem and calyx as blemishes. 

Further in accordance with a preferred embodiment of the present invention the blemish detector is also 
operative to ignore certain color variations in the vicinity of the stem and calyx. 

Still further in accordance with a preferred embodiment of the present invention the stem/calyx identifier 
includes a valley contour detector. 
40 There is additionally provided in accordance with a preferred embodiment of the present invention appa- 

ratusfor inspecting and handling agricultural produce having a stem and a calyx including a stem/calyx identifier 
for determining the locations of the stem and the calyx of the agricultural produce, and a mechanical operator, 
receiving an output of the stem/calyx identifier, for carrying out a mechanical operation on the agricultural pro- 
duce which takes into account the locations of the stem and the calyx. 
45 Also in accordance with a preferred embodiment of the present invention the mechanical operator includes 

a cutter. 

Moreover in accordance with a preferred embodiment of the present invention the mechanical operator 
includes a produce marker. 

Further in accordance with a preferred embodiment of the present invention the mechanical operator in- 
50 eludes a produce packer. 

Still further in accordance with a preferred embodiment of the present invention the mechanical operator 
includes a produce sorter. 

There is also provided in accordance with a preferred embodiment of the present invention apparatus for 
inspecting articles including a camera, and a spectral filter defining a plurality of light paths from an article to 
55 be inspected to the camera, the plurality of light paths having different spectral characteristics, wherein the 
spectral filter includes a prism operative to provide a plurality of images of the article having different spectral 
characteristics and being disposed in generally non-overlapping positions on an image plane of the camera. 

There is further provided in accordance with a preferred embodiment of the present invention apparatus 
for inspecting articles including an enclosure formed of a generally translucent light diffusing material, an ex- 
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ternal illuminator for illuminating the enclosure from the exterior thereof, an article driver for causing articles 
to be inspected to pass through the enclosure, and a camera for inspecting the articles as they pass through 
the enclosure. 

5 Also in accordance with a preferred embodiment of the present invention the enclosure is generally sphe- 

rical. 

Additionally in accordance with a preferred embodiment of the present invention the external illuminator 
includes a plurality of light sources surrounded by a reflector. 

Further in accordance with a preferred embodiment of the present invention the enclosure and the exter- 
10 nal illuminator are operative to provide generally uniform illumination of the article as it is inspected. 

Still further in accordance with a preferred embodiment of the present invention the enclosure and the 
external illuminator are operative to provide a generally uniform background for the article, as the article is 
inspected. 

Also in accordance with a preferred embodiment of the present invention the article driver includes a non- 
75 contact passage provider operative to provide non-contact passage of the articles through the enclosure. 

Moreover in accordance with a preferred embodiment of the present invention the external illuminator is 
sealed from the inside of the enclosure. 

Additionally in accordance with a preferred embodiment of the present invention the camera is operative 
to inspect generally all exposed surfaces of the article generally simultaneously. 
20 Further provided in accordance with a preferred embodiment of the present invention is apparatus for in- 

specting articles including a camera operative to inspect generally all exposed surfaces of the article generally 
simultaneously. 

Still further in accordance with a preferred embodiment of the present invention the apparatus includes 
an article supporter/conveyer for supporting and conveying articles to be inspected on an article bearing ele- 
25 ment configured such that substantially insignificant portions of the surfaces of the article are obscured from 
inspection. 

Also in accordance with a preferred embodiment of the present invention the article bearing element has 
a generally horizontal configuration and wherein the article supporter/conveyer also includes apparatus for 
driving the articles along the article bearing element. 

30 Additionally provided in accordance with a preferred embodiment of the present invention is apparatus for 

inspecting articles including an IR imager for generating an IR image of an article, a color imager for generating 
a color image of an article, and a defect detector receiving outputs from the IR imager and from the color imager 
for combining the outputs and for providing an output indication of defects based on information including in- 
formation derived from combining the outputs. 

35 Further in accordance with a preferred embodiment of the present invention the article bearing element 

has a mesh configuration. 

Still further in accordance with a preferred embodiment of the present invention the apparatus includes 
a camera operative to inspect generally all exposed surfaces of the article, and an image processor for pro- 
viding a reconstruction of the exposed surfaces of an article in which substantially every point on the exposed 
40 surfaces of the article is reconstructed exactly once. 

Also in accordance with a preferred embodiment of the present invention the apparatus include an image 
processor for providing a reconstruction of the exposed surfaces of an article in which substantially every point 
on the exposed surfaces of the article is reconstructed exactly once, wherein the camera is operative to inspect 
generally all exposed surfaces of an article. 
45 There is further provided in accordance with a preferred embodiment of the present invention apparatus 

for inspecting articles including a camera operative to inspect generally all exposed surfaces of the article, 
and an image processor for providing a reconstruction of the exposed surfaces of an article in which substan- 
tially every point on the exposed surfaces of the article is reconstructed exactly once. 

^Further in accordance with a preferred embodiment of the present invention the camera is operative to 
so inspect generally all exposed surfaces of an article generally simultaneously. 

Still further in accordance with a preferred embodiment of the present invention the camera includes at 
% least first and second camera units. 

Also in accordance with a preferred embodiment of the present invention the image processor includes 
apparatus for reconstructing predetermined at least first and second substantially nonoverlapping portions of 
55 the article in accordance with the images generated by the at leastf irst and second camera units respectively. 

Also in accordance with a preferred embodiment of the present invention the predetermined portions of 
the article are determined in accordance with a predetermined model of the shape of the article, the model 
defining at least one model parameter. 

Additionally in accordance with a preferred embodiment of the present invention the at least first and sec- 
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ond camera units includes at least first, second and third camera units. 

Moreover in accordance with a preferred embodiment of the present invention the camera is operative to 
inspect at least 70 percent of the exposed surface of an article. 
5 Further in accordance with a preferred embodiment of the present invention the camera is operative to 

inspect at least 80 percent of the exposed surface of an article. 

Still further in accordance with a preferred embodiment of the present invention the camera is operative 
to inspect at least 90 percent of the exposed surface of an article. 

Also in accordance with a preferred embodiment of the present invention the camera is operative to inspect 
10 at least 95 percent of the exposed surface of an article. 

Additionally in accordance with a preferred embodiment of the present invention the apparatus includes 
an image-model comparison unit for comparing an image of at least a portion of the article to the predetermined 
model of the shape of the article and for correcting the determination of the predetermined portions of the 
article to take into account discrepancies between the actual shape of the article and the predetermined model 
15 thereof. 

Moreover in accordance with a preferred embodiment of the present invention the image processor in- 
cludes apparatus for comparing first and second images of first and second respective portions of the article 
generated by the first and second camera units respectively, thereby to identify overlap between the first and 
second images. 

20 Further in accordance with a preferred embodiment of the present invention the article is supported by 

an article supporting element disposed intermediate the article and the camera and wherein the image proc- 
essor includes an article supporting element identifier for differentiating an image of the article supporting ele- 
ment from the image of the article. 

Still further in accordance with a preferred embodiment of the present invention the stem/calyx identifier 
25 also includes apparatus for inspecting a putative location of the stem and of the calyx relative to the shape of 
the fruit and for rejecting putative locations which are not located generally one opposite the other. 

There is also provided in accordance with a preferred embodiment of the present invention internal refer- 
enced apparatus for inspecting the color of an agricultural product including a spectral standard device, a prod- 
uct and spectral standard imager operative to image an agricultural product together with the spectral standard 
30 device, and a product-spectral standard comparator operative to determine the spectral characteristics of the 
agricultural product relative to the spectral standard device by comparing images thereof. 

Also in accordance with a preferred embodiment of the present invention the at least one model parameter 
includes at least one parameter which is derived from images of individual articles. 

Additionally in accordance with a preferred embodiment of the present invention the plurality of images 
35 of the article includes at least one IR image of the article. 

Further in accordance with a preferred embodiment of the present invention the article bearing element 
includes a plurality of elongate elements in generally parallel orientation. 

There is still further provided in accordance with a preferred embodiment of the present invention appa- 
ratus for inspecting agricultural produce substantially without bruising or squashing, including a camera for in- 
40 specting delicate agricultural produce, a non-contact passage provider operative to provide substantially non- 
contact passage of the delicate agricultural produce through the field of view of the camera, and a damper for 
receiving the delicate agricultural produce from the non -contact passage provider substantially without bruising 
or squashing the delicate agricultural produce. 

Also in accordance with a preferred embodiment of the present invention the damper includes at least one 
45 brush element 

Additionally in accordance with a preferred embodiment of the present invention the damper includes an 
enclosure containing liquid. 

Further in accordance with a preferred embodiment of the present invention the damper includes a se- 
quencer for receiving the delicate agricultural produce in sequence and for maintaining the sequence. 
so Still further in accordance with a preferred embodiment of the present invention the sequencer includes 

a container of liquid for sequentially flushing away a sequence of agricultural products. 

Also in accordance with a preferred embodiment of the present invention the article bearing element has 
an inclined configuration. 

There is additionally provided in accordance with a preferred embodiment of the present invention appa- 
55 ratus for imaging articles in motion for subsequent inspection including a camera for imaging an article in mo- 
tion, an article entry detector for repeatedly analyzing a small portion of the field of view of the camera in order 
to detect entry of the article thereto. 

Moreover in accordance with a preferred embodiment of the present invention the apparatus includes a 
low-level illuminator for providing a low level of illumination sufficient for detecting the presence of the article, 
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a high-level illuminator for providing a high level of illumination sufficient for inspecting characteristics of the 
article, and a high illumination trigger which receives an indication of the entry of the article into the small por- 
tion of the field of view from the article entry detector and triggers the high-level illuminator. 

5 Further in accordance with a preferred embodiment of the present invention the apparatus includes an 

article characteristic analyzer for analyzing characteristics of the article, and an analyzer trigger for receiving 
an indication of the entry of the article into the small portion of the field of view from the article entry detector 
and for triggering the characteristics analyzer. 

Still further in accordance with a preferred embodiment of the present invention the article entry detector 

10 includes apparatus for repeatedly computing a difference between a digitized first image of the field of view 
and a digitized subsequent image of the field of view. 

There is additionally provided in accordance with a preferred embodiment of the present invention a sin- 
gulation method including the steps of conveying articles In sequence without physically separating adjacently 
disposed articles along the conveyor. 

15 There is further provided in accordance with a preferred embodiment of the present invention a singulation 

method including the steps of conveying articles in sequence without controlling the distances between ad- 
jacent article positions. 

There is still further provided in accordance with a preferred embodiment of the present invention an agri- 
cultural produce inspection method including the steps of inspecting a representation of an entity forming at 
20 least a portion of an agricultural product, and employing fuzzy logic criteria in order to classify the entity ac- 
cording to a predetermined classification scheme. 

Also in accordance with a preferred embodiment of the present invention the small portion of the field of 
view includes a one-dimensional array of pixels. 

Additionally in accordance with a preferred embodiment of the present invention the camera is operative 
25 to inspect the agricultural produce by imaging. 

Further provided in accordance with a preferred embodiment of the present invention is a method for in- 
specting agricultural produce having a stem and a calyx including the steps of optically determining the loca- 
tions of the stem and the calyx of the agricultural produce, and detecting blemishes by cooperating with the 
optical determining step in order to avoid false detections of the stem and calyx as blemishes. 
30 Still further provided in accordance with a preferred embodiment of the present invention is a method for 

inspecting and handling agricultural produce having a stem and a calyx including the steps of optically deter- 
mining the locations of the stem and the calyx of the agricultural produce, and employing the results of the 
determining step in order to carry out a mechanical operation on the agricultural produce. 

There is also provided in accordance with a preferred embodiment of the present invention a method for 
35 imaging articles in motion for subsequent inspection including the steps of providing a camera for imaging an 
article in motion, and repeatedly analyzing a small portion of the field of view of the camera in order to detect 
entry of the article thereto. 

There is additionally provided in accordance with a preferred embodiment of the present invention a meth- 
od for inspecting articles including the steps of illuminating an enclosure, formed of a generally translucent 
40 light diffusing material, from the exterior of the enclosure, causing articles to be inspected to pass through the 
enclosure, and inspecting the articles as they pass through the enclosure. 

There is moreover provided in accordance with a preferred embodiment of the present invention a method 
for inspecting articles including the step of inspecting generally all exposed surfaces of the article generally 
simultaneously. 

45 There is still further provided in accordance with a preferred embodiment of the present invention a method 

for inspecting articles including the steps of generating at least one IR image of an article, generating a color 
image of an article, and analyzing the images and providing an output indication of defects in the articles. 

Also provided in accordance with a preferred embodiment of the present invention is an internally refer- 
enced method for inspecting the color of an agricultural product including the steps of imaging an agricultural 

50 product together with a spectral standard device, and determining the spectral characteristics of the agricul- 
tural product relative to the spectral standard device by comparing images thereof. 

Additionally provided in accordance with a preferred embodiment of the present invention is a method for 
inspecting delicate agricultural produce substantially without bruising or squashing, including the steps of pro- 
viding a camera for inspecting delicate agricultural produce, providing for substantially non-contact passage 

55 of the delicate agricultural produce through the field of view of the camera, and receiving the delicate agricul- 
tural produce following the non-contact passage substantially without bruising or squashing the delicate agri- 
cultural produce. 

In accordance with a preferred embodiment of the present invention the camera includes a line scanner. 
There is provided in accordance with a preferred embodiment of the present invention a method for in- 
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specting agricultural produce including the steps of associating an indication of at least one characteristic of 
an individual item of agricultural produce with the individual item of produce. 

Further in accordance with a preferred embodiment of the present invention the step of associating in- 
5 eludes the step of affixing a sticker to the individual item of produce, wherein the sticker bears an indication 
of at least one characteristic of the individual item. 

There is additionally provided in accordance with a preferred embodiment of the present invention appa- 
ratus for inspecting agricultural produce including a produce labelling unit operative to associate an indication 
of at least one characteristic of an individual item of agricultural produce with the item of produce, and a produce 
10 inspection unit operative to automatically inspect at least one characteristic of an individual item of produce 
and to provide an indication of the at least one characteristic to the produce labelling unit. 

Further in accordance with a preferred embodiment of the present invention the at least one characteristic 
includes at least one of the following characteristics variety, size, weight, grade, color, and price. 

There is also provided in accordance with a preferred embodiment of the present invention a singulator 
15 including a conveyor configured and arranged to convey articles in sequence, characterized in that no element 
is provided to separate adjacently disposed articles along the conveyor. 

There is additionally provided in accordance with a preferred embodiment of the present invention a sin- 
gulator including a conveyor configured and arranged to convey articles in sequence without controlling the 
distances between adjacent article positions. 
20 Further in accordance with a preferred embodiment of the present invention the conveyor includes a plur- 

ality of elongate elements arranged in the direction in which the articles are conveyed. 

Still further in accordance with a preferred embodiment of the present invention the plurality of elongate 
elements includes a plurality of cables. 

There is further provided in accordance with a preferred embodiment of the present invention a singulator 
25 including a conveyor configured and arranged to convey articles in sequence, wherein the conveyor includes 
a plurality of strings of beads. 

There is also provided in accordance with a preferred embodiment of the present invention a method for 
inspecting agricultural produce including the steps of generating an image of individual agricultural products, 
and automatically grading agricultural products by receiving the image generated by the imager and providing 
30 an output indication of a grade for the individual agricultural product. 

There is further provided in accordance with a preferred embodiment of the present invention an agricul- 
tural produce inspection system including a fuzzy logic image entity classifier which employs fuzzy logic criteria 
in order to inspect a representation of an entity forming at least a portion of an agricultural product and to clas- 
sify the entity according to a predetermined classification scheme. 
35 Additionally in accordance with a preferred embodiment of the present invention the agricultural product 

is expected to have at least one discolored area on its surface and wherein the entity includes a discolored 
portion of the agricultural product and wherein the predetermined classification scheme includes two classes: 
expected discoloration, and unexpected discoloration. 

Further in accordance with a preferred embodiment of the present invention the entity includes a pair of 
40 discolored areas and the predetermined classification scheme includes a binary classification scheme includ- 
ing a first class of stem/calyx and a second class of not stem/not calyx. 

Still further in accordance with a preferred embodiment of the present invention the predetermined clas- 
sification scheme includes a plurality of classes corresponding to a plurality of types of blemishes. 

Also in accordance with a preferred embodiment of the present invention the entity includes the agricul- 
45 tural product and wherein the predetermined classification includes a plurality of classes corresponding to a 
plurality of grades of agricultural produce. 

Additionally in accordance with a preferred embodiment of the present invention the representation of the 
entity is derived by employing fuzzy logic criteria in order to inspect a representation of at least one subentity 
forming a portion of the entity. 
so There is also provided in accordance with a preferred embodiment of the present invention an agricultural 

produce inspection system including an imager for generating an image of individual agricultural products, and 
an automatic agricultural product grading unit including an image processor receiving the image generated by 
the imager and providing an output indication of a grade for the individual agricultural product. 

Further in accordance with a preferred embodiment of the present invention the grading unit is user- 
55 tunable such that criteria employed by the grading unit may be modified by the user. 

Still further in accordance with a preferred embodiment of the present invention the grading unit includes 
a user-tunable fuzzy logic unit. 

Also in accordance with a preferred embodiment of the present invention the fuzzy logic image entity clas- 
sifier includes an entity representation fuzz if ication unit, entity classification rule inference logic, and an entity 
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classification defuzzif ication unit. 

Additionally in accordance with a preferred embodiment of the present invention a plurality of classification 
rules are employed, each rule corresponding to an individual class and having associated therewith, for each 
5 entity to be classified, a degree of belief, wherein the entity classification defuzzif ication unit is operative to 
identify, for each entity, a classification rule having a maximal degree of belief and to associate the entity with 
the class corresponding to the classification rule having the maximal degree of belief. 

There is further provided in accordance with a preferred embodiment of the present invention apparatus 
for detecting blemishes on agricultural produce, the apparatus including a dual IR illumination system operative 
10 to provide IR band I and IR band II illumination of the agricultural produce, and a sensor operative to receive 
first and second images of the agricultural produce as illuminated by the IR band I and IR band II illumination 
respectively, a comparison operator operative to compare the first and second images and to generate an out- 
put indication of blemishes, wherein the wavelength bands of the band I IR and band II IR illuminations are 
selected such that artifacts resembling blemishes are similarly detected by the two illuminations whereas blem- 
15 ishes are differently detected in the two illuminations. 

Still further in accordance with a preferred embodiment of the present invention the wavelength band of 
the band I IR illumination includes approximately 0.67 - 0.77 microns and the wavelength band of the band II 
IR illumination includes approximately 0.77 - 0.95 microns. 

Moreover in accordance with a preferred embodiment of the present invention the comparison operator 
20 includes an arithmetic operation. 

Further in accordance with a preferred embodiment of the present invention the article includes an agri- 
cultural produce. 

Still further in accordance with a preferred embodiment of the present invention the agricultural produce 
includes an apple. 

25 Also in accordance with a preferred embodiment of the present invention the article includes a round ar- 

ticle. 

Additionally in accordance with a preferred embodiment of the present invention the agricultural produce 
• includes a round article. ... 

There is also provided in accordance with a preferred embodiment of the present invention conveying ap- 
30 paratus for agricultural produce including a produce supporting cable assembly including a plurality of cables 
arranged to support agricultural produce. 

Further in accordance with a preferred embodiment of the present invention the conveying apparatus in- 
cludes an additional cable assembly interlaced with the produce supporting cable assembly. 

Still further in accordance with a preferred embodiment of the present invention the conveying apparatus 
35 includes a kicker element, and a kicker element activator operative to slide the kicker element between the 
produce supported by the cable assembly so as to allow the kicker element to engage the produce and to re- 
move the produce from the plurality of cables. 

Also in accordance with a preferred embodiment of the present invention the spectral filter includes a non- 
pyramidal prism. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated from the following detailed description, taken in 
conjunction with the drawings in which: 
45 Fig. 1 is a block diagram of an electro-optic sorting and grading system constructed and operative in ac- 

cordance with a preferred embodiment of the present invention; 

Fig. 2 is a block diagram of a sorting and grading line constructed and operative in accordance with a pre- 
ferred embodiment of the present invention and including the electro-optic sorting and grading system of 
Fig. 1; - 

50 Fig. 3A is a side view illustration of conveying apparatus for conveying or transporting agricultural produce 

substantially without contacting or obscuring the agricultural produce during imaging, useful in the embodi- 
ment of Fig. 1 , which is constructed and operative in accordance with a first preferred embodiment of the 
present invention; 

Fig. 3B is a cross sectional schematic illustration of an article receiving system which is a portion of the 
55 apparatus of Fig. 3A and is constructed and operative in accordance with a second preferred embodiment 

of the present invention; 

Fig. 4A is a schematic illustration of conveying apparatus useful in the embodiment of Fig. 1 which is con- 
structed and operative in accordance with a preferred embodiment of the present invention wherein agri- 
cultural produce rolls down an inclined plane defined by a plurality of elongate elements having a downward 
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projection of relatively small area; 

Figs. 4B and 4C are cross-sectional illustrations of the plurality of elongate elements of Fig. 4A, arranged 
in accordance with alternative embodiments of the present invention; 
5 Fig. 5 is a perspective illustration of a portion of the apparatus of Fig. 4A; 

Fig. 6 is a side view illustration of conveying apparatus similar to the apparatus of Fig. 4A but wherein the 
plurality of generally parallel elogate elements is replaced by an element having a screen or mesh type 
configuration; 

Fig. 7 is a schematic illustration of conveying apparatus useful in the embodiment of Fig. 1 which is con- 
w structed and operative in accordance with a preferred embodiment of the present invention wherein agri- 

cultural produce to be imaged is actively conveyed along a generally horizontal pathway defined by a plur- 
ality of elongate elements having a downward projection of relatively small area; 

Fig. 8 is a perspective illustration of apparatus similar to the apparatus of Fig. 7 except that 4 pulleys are 
employed rather than 3 pulleys as in Fig. 7; 
15 Fig. 9 is a side view illustration of conveying apparatus similar to the apparatus of Fig. 7 but having a screen 

or mesh type configuration rather than an elongate configuration; 

Fig. 10 is a perspective view partially cut away illustration of a diffuse illumination and imaging enclosure 
useful in the embodiment of Fig. 1; 

Fig. 11 is an optical diagram of the illumination apparatus of Fig. 10; 
20 Fig. 12 is a schematic illustration of the fields of view of each of the cameras of the imaging apparatus of 

Fig. 10; 

Fig. 13 is a perspective view partially cut away illustration of a generally truncated spherical diffuse illu- 
mination and imaging apparatus useful in the embodiment of Fig. 1; 
Fig. 14 is a cross sectional illustration of the apparatus of Fig. 13; 
25 Fig. 15 is a pictorial illustration of an article in motion within the illumination and imaging apparatus of Figs. 

10 - 12 and a method for triggering illumination or article inspection when the article in motion reaches a 
predetermined position along its trajectory; 

Fig. 16 is a pictorial illustration of a spectral standard useful in conjunction with the illumination and imaging 
apparatus of Figs. 10 - 14; 

30 Fig. 17 is an optical schematic diagram of an electro-optical imaging unit forming part of the apparatus of 

Figs. 10 and 13, constructed and operative in accordance with a preferred embodiment of the present in- 
vention; 

Fig. 18 is a perspective illustration of a spectral splitting element which is useful in conjunction with the 
apparatus of Fig. 17, which is constructed and operative in accordance with a first preferred embodiment 
35 of the present invention; 

Fig. 19 is a cross sectional illustration of the apparatus of Fig. 18; 

Fig. 20 is a perspective illustration of a spectral splitting element which is useful in conjunction with the 
apparatus of Fig. 17, which is constructed and operative in accordance with a second preferred embodi- 
ment of the present invention; 
40 Fig. 21 is a pictorial illustration of an image generated by imaging an apple and a spectral standard using 

the apparatus of Fig. 18; 

Fig. 22 is an optical schematic diagram of a light projector forming part of the apparatus of Figs. 10 and 
13; 

Fig. 23 is a simplified flowchart of a preferred method for implementing the image processing unit 18 of 
45 Fig. 1; 

Fig. 24 is a simplified flowchart of a preferred method for finding the boundary of an article using an image 
of the article and a grid projected onto the article which is suitable for implementing step 1816 of Fig. 23; 
Fig. 25 is a simplified flowchart of a preferred method for implementing step 1820 of Fig. 23; 
Fig. 26 is a simplified flowchart of a preferred method for generating apple variety data to be loaded in 
50 step 1810 of Fig. 23; 

Fig. 27 is a pictorial illustration illustrating a preferred method for implementing step 1828 of Fig. 23; 
Fig. 28 is a graph of spectral characteristics of each of a plurality of filters employed in the apparatus of 
Fig. 18; 

Fig. 29 is a perspective illustration of the conveying apparatus of Fig. 7 in operative association with the 
55 imaging apparatus of Fig. 10; 

Fig. 30A is a simplified side view illustration of singulating apparatus including a conveying junction com- 
prising an interlaced pair of conveyors; 

Fig. 3 0B is a detailed cross-sectional illustration of a preferred implementation of one of the roller assem- 
blies of Fig. 30A; 
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Fig. 31 A - 31C illustrate apparatus for selectably ejecting articles from a cable conveyor onto a selected 
one of a plurality of bins corresponding to a plurality of categories into which the apples have been cate- 
gorized; 

5 Fig. 32 illustrates a preferred alternative to the conveying apparatus of Fig. 7; 

Fig. 33Aand Fig. 33B illustrate interlacing cables 2240 and 148 of Fig. 32; and 

Figs. 34A and 34B, taken together, form an electronic schematic diagram of components which are not 
commercially available and which are useful in conjunction with the Appendices attached herewith. 
Also submitted herewith are the following appendices: 
10 Appendix Ais a computer listing of a software implementation of a preferred method for implementing steps 

1813 and 1814 of Fig. 23; 

Appendix B includes a computer listing of a main program for an article inspecting system constructed and 
operative in accordance with a preferred embodiment of the present invention; 

Appendix C is a computer listing of a software implementation of a sample method for implementing the 
15 method of Fig. 24; 

Appendix D is a computer listing of a software implementation of a sample method for assigning identifying 
color codes to each of a plurality of locations in imaged StarKing apples; 

Appendix E is a computer listing of a software implementation of a sample method for implementing the 
method of Fig. 25; 

20 Appendix F is a computer listing of a software implementation of a preferred method for implementing steps 

1824 and 1828 of Fig. 23; 

Appendix G is a computer listing of a software implementation of a preferred method for implementing 
steps 1830 and 1832 of Fig. 23; 

Appendix H, taken together with Appendix I is a computer listing of a software implementation of a pre- 

25 . fer red method for implementing step 1834 of Fig. 23; . 

Appendix I includes a computer listing which, taken together with Appendix H f forms a computer listing of 
a software implementation of a preferred method for implementing step 1834 of Fig. 23, and also includes 
a computer listing of. a software implementation of a preferred method for implementing steps 1836 and 
1838 of Fig. 23. . . 

30 Appendix J includes computer listings of helper routines useful in conjunction with the other computer list- 

ings appended hereto; 

Appendix K includes computer listings of "include files" useful in conjunction with the other computer list- 
ings appended hereto; and 

Appendix L is a computer listing of a batch file useful in generating executable programs from the other 
35 computer listings appended hereto, and a DOS configuration file. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference is now made to Fig. 1 which is a block diagram of an electro-optic sorting and grading system 

40 referenced generally 10 which is constructed and operative in accordance with a preferred embodiment of the 
present invention. The apparatus of Fig. 1 comprises a conveying unit 12 which receives a sequence of articles 
to be sorted and graded and conveys the articles past an electro-optical imaging system 14. Preferably, con- 
veying unit 12 conveys the articles so as to allow simultaneous imaging of substantially every point along the 
surfaces of the articles. Conveying unit 12 may receive singulated articles or may receive articles in bulk. Va- 

45 rious embodiments for conveying unit 12 are described below with reference to Figs. 3A - 9 and 30 - 33. 

Electro-optical imaging system 14 preferably includes a plurality of simultaneously operative electro-optical 
imaging units for imaging each article in the sequence of articles from a corresponding plurality of angles. Pre- 
ferably, each imaging unit comprises a monochromatic camera unit and a spectral splitting or spectral sepa- 
ration element. Each monochromatic camera unit may comprise any suitable camera apparatus such as one 

50 or more line scanner cameras or such as, in the illustrated embodiment, as explained below with reference to 
Fig. 17, a CCD, CID or vidicon camera. The spectral splitting or spectral separation element, typically a prism, 
is operative to provide a plurality of non-overlapping images of each article, each image having different spec- 
tral characteristics. Imaging system 14 also preferably includes an illumination subsystem including a plurality 
of light sources, provided externally of an article-containing enclosure and sealed from the inside thereof. 

55 The light sources are preferably surrounded by a diffusive reflector which provides generally uniform illu- 

mination of the article and of the internal surface of the article-containing enclosure which serves as a back- 
ground when the article is imaged. Preferably, the article-containing enclosure is formed of a translucent ma- 
terial which diffuses light arriving from the light sources, thereby enhancing uniformity of illumination of the 
article. Electro-optical imaging system 14 is described in detail below with reference to the embodiments of 
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Figs. 10 and 13. 

The images of each article generated by imaging system 14 are provided to an image processing unit 18 
which is described below with reference to Fig. 23. Image processing unit 1 8 is operative to combine the outputs 
5 of the plurality of imaging units in order to quantify a plurality of features of the inspected articles. Preferably, 
almost every point along the surface of each article is represented exactly once in the analysis of image proc- 
essing unit 18. 

The feature information generated by image processing unit 18 is received by an article data analysis and 
sorting/grading/labelling unit 20. Analysis and sorting/grading/labelling unit 20 comprises a sorting and grading 
10 decision tree and is operative to categorize articles using a plurality of predetermined categories which may 
be based on size and/or shape and/or spectral characteristics such as color and/or presence of blemishes upon 
the articles. 

Preferably, unit 20 is also operative to label or otherwise mark each individual article with an indication 
of an individual feature thereof as determined by the sorting and grading decision tree, such as the grade there- 
15 of. 

It is appreciated that the apparatus of Fig. 1 may be used to form part of a fruit sorting and grading line 
such as the fruit sorting and grading line 50 of Fig. 2. As shown, fruit sorting/grading line 50 may include some 
or all of the following units in addition to the sorting and grading system 10 of Fig. 1, not necessarily in the 
illustrated sequence: an unloading unit 52, a fruit washing unit 54, a fruit drying tunnel 56, a fruit feeding unit 
20 or bulk conveyor 58, a singulator 60, optionally, and conveyor belts 62 for conveying the fruit to outlets for sort- 
ed, graded and, preferably, labelled fruits. 

Singulator 60 is operative to sequence a stream of fruit by creating parallel "lanes" 64 of fruit. Each fruit 
preferably has a well-defined position such as between two particular bicone rollers or within a particular cup 
or pocket. Typically, one electro-optical imaging unit 14 is provided per lane and the configuration of electro- 
25 optical imaging unit 14 is such that the lanes may be disposed relatively close together, as explained below 
in more detail with reference to Fig. 13. 

A mechanical kicker or air jet or other suitable means may be provided (not shown) which, in response to 
a suitable command from electro-optical unit 14, kicks or otherwise conveys an apple to an individual one of 
outlet conveyors 62. 

30 Fig. 3A is a side view illustration of conveying unit 12 of Fig. 1 which is constructed and operative in ac- 

cordance with a first preferred embodiment of the present invention. A particular feature of the embodiment 
of Fig. 3A is that the articles to be inspected are conveyed substantially without contact therewith during im- 
aging, thereby minimizing obscuring of the articles to be inspected. As shown, the apparatus of Fig. 3A com- 
prises an imaging space 80 in which the articles move substantially without being contacted and therefore sub- 

35 stantially without being obscured from imaging apparatus. The imaging space 80 may be enclosed by an en- 
closure 81 which may be identical to enclosure 230 of Fig. 10 or enclosure 300 of Fig. 13, both of which are 
described in detail below with reference to Figs. 10 and 13 respectively. 

A conveying and launching unit 82, typically configured as an endless driving chain, conveys articles, such 
as fruit arriving from lane conveyor 64 of Fig. 2, toward the imaging space 80 and provides horizontal velocity 

40 to the articles, thereby enabling them to move in a generally parabolic trajectory through the imaging space 
80. An unloading unit 84 receives articles which have travelled through imaging space 80 substantially without 
damaging the articles upon impact. Unloading unit 84 may also convey the articles to a desired location, such 
as to conveyor 62 of Fig. 2. Conveying and launching unit 82 may comprise an array of article supporting ele- 
ments 86 such as but not limited to cylindrical or biconical rollers, rubber cups, plastic cups or trays, or flexible 

45 pockets. 

Unloading unit 84 preferably comprises a damping element 96, for receiving a sequence of articles follow- 
ing passage of the articles through imaging space 80, and a conveyor 97. Damping element 96 typically re- 
ceives the articles without substantially damaging the article upon impact, and conveyor 97 then conveys ar- 
ticles onward while maintaining the sequence in which they were received. Conveyor 97 may be similar to con- 
50 veying and launching unit 82. 

According to one preferred embodiment of the present invention, damping element 96 may comprise a 
brush array 98. Brush array 98 may include two or more cylindrical brushes arranged parallel to one another 
and rotating in opposite directions at a suitable speed such as 45 rpm. Any suitable size and type of brush 
may be employed, such as a 25 cm diameter, 20 cm long nylon brush with split hair so as not to damage delicate 
55 produce. The distance between axes of adjacent cylindrical brushes may be approximately 50 cm. 

Alternatively, damping element 96 may comprise deformable cushions or bean bags (not shown) for damp- 
ing articles, such as those described in U. S. Patent 3,961,701 to Paddock et al, the disclosure of which is 
incorporated herein by reference. 

Reference is now made to Fig. 3B which is a cross-sectional illustration of a portion of conveying unit 12 



11 




EP 0 566 397 A2 

which is operative to convey agricultural produce away from electro-optical imaging system 14. The embodi- 
ment of Fig. 3B is substantially identical to the embodiment of Fig. 3A except that brush array 98 is replaced 
by a liquid based damping unit 100 and unloading unit 84 is replaced with a liquid-immersed unloading unit 

5 102 which may be substantially similar to unloading unit 84 except as specified hereinbelow: 

Liquid based damping unit 100 preferably comprises an open enclosure portion 103 within which airborne 
articles land one at a time in a liquid such as water. 

Unloading unit 102 is immersed in approximately 30 cm of water and includes cups 101, or any other suit- 
able element for scooping up articles from the water, which are configured so as to prevent disengagement of 

10 the articles from the cups due to water resistance to motion of the articles and of unloading unit 102. Preferably, 
cups 101 are perforated so that water may drain as articles are conveyed out of the water. 

An array of liquid jet outlets 104 is arranged along the interior walls of enclosure 103 in fluid communication 
with a liquid circulator 106 via a piping system 107. Liquid circulator 1 06 may comprise a high capacity centri- 
fugal pump which generates liquid circulation at a suitable rate such as 5 liter/sec. Liquid outlets 104 provide 

15 liquid fountains or streams which are operative to flush away an article which has landed within enclosure 1 03 
before the next article lands. 

Articles are flushed along a predetermined trajectory, in sequence, through a conduit portion 108 toward 
unloading unit 102 and eventually are conveyed out of damping unit 100 in sequence by unloading unit 102. 
The operation of unloading unit 102 is typically synchronized relative to the flow of articles to the system, so 

20 as to scoop up each article as it flows toward unloading unit 102. Preferably, the velocity of the article relative 
to the velocity of unloading unit 102 at the moment the article is scooped up by unloading unit 102 is zero. 
For apples and other articles which are lighter than water, the article has an upward component which is match- 
ed by the upward velocity component of unloading unit 102. 

Reference is now made to Figs. 4A- 4C and 5 which illustrate conveying unit 12 of Fig. 1 constructed and 

25 operative in accordance with a third preferred embodiment of the present invention. In the embodiment of Figs. 
4A- 4C and 5, agricultural produce rolls down an inclined pathway defined by a plurality of elongate elements 
which are configured to conceal a very small portion of the agricultural produce from imaging system 14 of 
Fig. 1: ■ * 

As shown, the apparatus of Figs. 4A- 4C and 5 comprises an inclined unit 110, a loading unit or singulator 

30 112 and an unloading unit 114 which may be similar to unloading unit 84 of Fig. 3A. Singulator 11 2 may comprise 
a roller conveyor as shown or a cups conveyor such as conveyor 82 in Fig. 3A or more generally any suitable 
conveying element such as a conveyor forming part of an existing sorting and grading line. 

Inclined unit 110 typically includes a plurality of cables 120 which are arranged substantially parallel to 
one another and to the path along which the articles are to be conveyed. Any suitable number of suitable 

35 spaced cables may be employed, such as three cables spaced 20 - 40 mm apart. Each cable may be formed 
from any suitable material which is preferably relatively strong so as to allow the cross sectional diameter of 
the cables to be small, such as approximately 1-3 mm, thereby minimally obscuring the articles when viewed 
through the cables. For example, cables may be formed of nylon or plastic coated steel, or of plastic coated 
polysterene or aramid fibers. The length of cables 120 may be approximately 100- 120 cm. 

40 As shown in Figs. 4B and 4C, the cables 120 when viewed in cross section may for example be arranged 

at equal intervals along an approximately 120 degree arc of an 8 cm diameter circle. 

Cables 120 are typically arranged at a suitable angle such as approximately 20 - 40 degrees from the hor- 
izontal. The cables may be supported by a rigid frame 122 which maintains a suitable level of tension such as 
approximately 50 kg by means of suitable tensioning elements such as an array 123 of springs. The articles, 

45 as they roll down the cables, gain velocity and the angle and length of the cables are preferably selected such 
that only one article is in the field of the view of the imaging cameras at any one time. 

Loading unit 112 is positioned as close as possible to the high end 124 of the cables, at an elevation the 
same as or slightly exceeding the height of the high end 124 of the cables, so that articles will tend to be de- 
posited from loading unit 112 directly onto the cables 120. 

50 Fig. 6 illustrates an alternative embodiment of conveying unit 12 of Fig. 1. The embodiment of Fig. 6 is 

similar to the embodiment of Figs. 4 and 5, however, the cables 120 are replaced by a net 130 arranged at a 
suitable angle to the horizontal, such as 40 - 50 degrees. The articles roll down the length of the net, which 
may be approximately 110 - 130 cm long. Loading onto the net and unloading therefrom may be as described 
above with reference to Figs. 4A - 4C and 5. 

55 Any suitable net or mesh may be employed which obscures the articles as little as possible when the ar- 

ticles are viewed through the net. For example, a net or mesh may be formed of nylon threads 0.3 - 0.8 mm 
in diameter and spaced a pp proximately 20 to 30 mm apart. The net 130 may be supported by a rigid frame 
132 which preferably includes means, such as an array 136 of springs, for maintaining the net 130 at a level 
of tension sufficient to ensure that articles rolling along the net depress the net by no more than approximately 



12 



m 



' EP 0 566 397 A2 

V 

2 cm. 

According to one embodiment of the present invention, the frame 132 comprises a pair of net-supporting 
cables 134 disposed on both sides of the net 130. Cables 134 may be approximately 20 cm apart and provide 
5 a suitable level of tension such as approximately 20 kg such that, when the net 130 is supporting an article, 
the lowest point of the net 130 is approximately 3 cm below the cables 134. 

Alternatively, the cables may be eliminated and tension in the net may be provided by springs 136. 

Figs. 7 and 8 illustrate an alternative embodiment of conveying unit 12 of Fig. 1. The embodiment of Figs. 
7 and 8 is similar to the embodiment of Figs. 4A -C and 5 except for the following differences. The cables 120 
10 of Figs. 4A-C and 5 are replaced by driven cables 148 which may be oriented generally horizontally rather than 
being arranged along an inclined plane. Typically, the angle between cables 148 and the horizontal is within 
the range of +/- 5 degrees. Cables 148 are preferably closed loops formed of a suitable material such as plas- 
ticized PVC or such as steel or polyester or aramid fibers coated with plasticized PVC or nylon or polyurethane. 

A cable supporting unit 150 is provided for tensioning the pulleys at about 30 - 50 kg. Cable supporting 
15 unit 150 preferably comprises an array of coaxial guiding pulleys 152 comprising outer pulleys 154 and inner 
pulleys 156. Inner pulleys 156, which support central cables 155, are typically smaller than outer pulleys 154, 
which support peripheral cables 157, such that central cables 155 are supported below peripheral cables 157, 
providing a cradle-like configuration of cables 148. For example, outer pulleys 154 may have diameters of ap- 
proximately 100 mm and inner pulleys 156 may have diameters of approximately 70 mm. Each pulley is pre- 
20 ferably independent or disengaged relative to the other pulleys. 

A cable driving unit 160 is provided for driving the cables 148. Cable driving unit 160 preferably comprises 
an array 162 of drive/power pulleys which are coaxially mounted on an electric motor shaft 164. Preferably, 
all driveypower pulleys have the same diameter, such as approximately 100 mm, in order to maintain a uniform 
linear speed for all of cables 148, such as approximately 1.2-1.4 m/sec. 
25 Preferably, a loading unit or singulator 1 70 is provided which is generally similar to singulator 112 of Figs. 

4A- 5. However, loading unit 170 is configured and arranged relative to cables 148 such that, once loaded 
onto the cables, articles remain generally stationary relative to the cables and do not roll. Also, preferably, the 
cables move the articles such that only one article at a time is within the field of view of the imaging apparatus. 
The velocity of loading unit 170 is preferably approximately 50 cm/sec. 
30 An unloading unit 172 is provided which may be similar to unloading unit 114 of Fig. 4A. 

Fig. 9 illustrates an embodiment of conveying unit 12 of Fig. 1 which is a variation on the embodiment of 
Figs. 7 and 8. The embodiment of Fig. 9 is similar to the embodiment of Figs. 7 and 8 except for the following 
differences. 

The cables 148 are replaced with a net 180 which may be similar to net 130 of Fig. 6 and which may be 
35 supported at a tension level of approximately 10 kg. 

According to one embodiment of the present invention, cables 190 which are similar to cables 134 of Fig. 
6 support both sides of the net and are supported by pulleys 192 associated with a motor 194. Motor 194 via 
pulleys 192 convey the cables 190 in endless motion at a suitable linear velocity such as approximately 0.4 
m/sec. 

40 According to an alternative embodiment of the present invention, cables 190 are omitted. In this embodi- 

ment the tension of the net 180 is relatively low, such as approximately 5 kg. 

The linear speed at which articles are conveyed along the net may be approximately 0.4 m/sec. 
A particular feature of the embodiments of Figs. 3A- 9 is that a large proportion of the surface area of the 
articles to be inspected is unobscured from any angle and may be imaged, such as 80%, 90%, 95% or more 
45 of each article. A plurality of imaging units may be employed such as two, three, four or more imaging units 
arranged to image the article from different angles. 

Reference is now made to Fig. 1 0 which is a perspective view partially cut away illustration of electro-optical 
imaging system 1 4 of Fig. 1 constructed and operative in accordance with a preferred embodiment of the pres- 
ent invention. The apparatus of Fig. 1 0 preferably includes a plurality of simultaneously operative electro-optical 
so imaging units for imaging each article in the sequence of articles from a corresponding plurality of angles. In 
the illustrated embodiment, four electro-optical imaging units are provided of which three are shown, referenced 
210, 212 and 214. Preferably, each imaging unit includes a camera unit 216 described in detail below with ref- 
erence to Fig. 17. 

Optionally, associated with each imaging unit is a light projector 218 equipped with a grid-shaped mask 
55 (not shown) which projects a grid image onto the article and onto a background surface such as the inner sur- 
face of an imaging enclosure 230, so that the camera unit 216 may image the grid image superimposed onto 
each article. The lines or stripes of the grid, when superimposed on the article, are distorted as a function of 
convexity/concavity of the article. Therefore, by projecting a predetermined pattern, such as a grid pattern, 
onto an article, convexity/concavity information regarding the article may be derived. Specifically, grid projec- 
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tion is useful in detecting local depressions or "valleys" on an otherwise generally spherical surface, which val- 
leys are putative locations of a fruit stem or calyx. 

Methods for analyzing 3D surfaces using projected light grids are discussed in the following reference, 
5 the disclosure of which is incorporated herein by reference: Hu, G. and Stockman, G. "3D surface solution using 
structured light and constraint propagation", IEEE Trans, on PAMI, Vol. 4, 390 - 402, 1989. 
Atypical light projector is described in detail below with reference to Fig. 22. 

Articles may travel into enclosure 230 for imaging through an entrance opening 234 and may exit enclosure 
230 after being imaged through an exit opening 236. Preferably a pair of imaging apertures 237 and 238 (Fig. 

10 1 2) each of suitable shape and size such as a 7 cm diameter circle are defined in enclosure 230 for each imaging 
unit. Apertures 237 and 238 provide optical communication between the interior of imaging enclosure 230, and 
camera unit 21 6 and optional grid projector 21 8, respectively, of each imaging unit. Each imaging aperture may 
be fitted with an optical glass window 239 (Fig. 12) of suitable thickness such as 3 mm. Each window 239 may 
be attached, preferably seaiingly attached, to the enclosure 230 by any suitable means. For example, windows 

15 239 may be glued into apertures 237 and 238 or alternatively may be attached by means of O-rings and brack- 
ets. 

The apparatus of Fig. 10 also preferably includes an illumination subsystem including a plurality of light 
sources 240, provided externally of generally spherical enclosure 230 and sealed from the inside thereof. Any 
suitable number of light sources may be provided, such as 18 50 W light sources, generally symmetrically ar- 

20 ranged along the internal surface of a diffusive reflective housing 250 so as to be generally equidistant from 
the surface of enclosure 230 and so as to be as distant as possible therefrom, thereby enhancing diffuseness 
of illumination and providing generally uniform illumination of the article. The light sources may comprise con- 
ventional incandescent, tungsten-halogen, fluorescent, rare-earth xenon or krytpon arc lamps or flash lamps 
and are preferably operative to provide a relatively flat spectrum of light ranging from green to near infra-red. 

25 The imaging units 210, 212 and 214 are preferably supported by the housing 250 or alternatively, as shown, 

may be supported by enclosure 230. 

The diffusive reflector housing 250 may be formed of structural panels of metal, plastic or wood which are 
coated from the inside with a white scattered diffuser material such as white alkyd non-glossy paint or white 
laminated thermosetting panels. Typically, cooling fans or other cooling means (not shown) are provided ex- 

30 ternally to housing 250 to cool the sealed space between enclosure 230 and housing 250. Alternatively or in 
addition, fanning or ventilation of the sealed space are provided. 

According to a preferred embodiment of the invention, enclosure 230 is formed of a translucent material 
such as ground glass, opal glass or a plastic such as polycarbonate, polyethylane, high impact polystyren or 
acrylic. Enclosure 230 diffuses light arriving from light sources 240, thereby enhancing uniformity of illumin- 

35 ation of articles inside enclosure 230. 

The diffusive reflector housing 250 also preferably provides generally uniform illumination of the internal 
surface of the enclosure 230 thereby providing a generally uniformly illuminated background for imaging of 
articles inside the enclosure 230. 

A suitable diameter for enclosure 230 is approximately 60 cm. Suitable dimensions for housing 250 is 80 

40 cm x 80 cm x 80 cm. It is appreciated that the housing 250 need not be in the shape of a cube. Any suitable 
shape may be employed, such as a sphere or right cylinder having circular or polygonal cross-section. Accord- 
ing to a preferred embodiment of the present invention, the cross section of the right cylinder, which defines 
side surfaces of the imaging enclosure, is a circle or a polygon having a number of sides which is an integer 
multiple of the number of imaging units, for reasons of symmetry. For example, if three imaging units are em- 

45 ployed, the cross-section may be an equilateral hexagon. 

Fig. 11 is an optical diagram of the illumination apparatus of Fig. 10. As shown, illumination is preferably 
provided from a plurality of symmetric directions such as four symmetric directions, if four coplanar imaging 
units are employed. 

Fig. 12 is a schematic illustration of the intersections 270 of the internal surface of enclosure 230 with the 
50 fields of view of the four imaging units of Fig. 10. Each of the four intersections 270 serves as a background 
on which the article is imaged by the corresponding imaging unit. The backgrounds are preferably back- 
illuminated by light travelling between spherical enclosure 230 and housing 250, and further illuminated by light 
scattered within enclosure 230, as explained above. Preferably, the backgrounds are homogeneously bright 
within a range of +/- 5%. 

55 Preferably, each background is brighter than the brightest location on the article because the back- 

grounds, and not the articles, are backlit. The difference in lighting between article and background facilitates 
easy distinction between article and background in image processing. 

Optionally, a spectral standard, serving as an internal, on-line imaged reference to which the image of the 
article may be compared, is placed along the interior surface of enclosure 230, within each of backgrounds 
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270. Each spectral standard is positioned at a suitable location such as adjacent the edge of the respective 
background 270 such that the corresponding imaging unit may simultaneously image an article to be inspected 
and the spectral standard. Each spectral standard may be reflective or transparent and may be attached as 

5 by an adhesive to the internal surface of the imaging enclosure 230. A sample spectral standard is described 
below with reference to Fig. 16. 

Figs. 13 and 14 are a perspective view partially cut away illustration and a cross sectional illustration, re- 
spectively, of apparatus which is a variation of the apparatus of Fig. 10. The apparatus of Fig. 13 is similar to 
the apparatus of Fig. 10, however, spherical enclosure 230 is replaced by an enclosure 300 which resembles 

10 spherical enclosure 230 except that its configuration is that of a truncated sphere. The circumference 302 of 
the circle of truncation may be approximately 65 percent of the circumference 310 of the spherical portion of 
truncated sphere 300. Imaging units may be positioned at equal intervals along the circumference 310. 

Preferably, the enclosure 300 has a plane of symmetry defined by circumference 310 on which three im- 
aging units are centered. In this embodiment, the two locations intersecting an axis 312 which is perpendicular 

15 to the plane defined by circumference 310 are typically not imaged and therefore, relatively poor illumination 
of these locations does not adversely affect operation. 

According to a preferred embodiment of the present invention, images of the articles travelling through 
enclosure 230 of Fig. 10 or enclosure 300 of Fig. 13 which are employed for subsequent analysis of the articles 
are generated in accordance with a predetermined time schedule. The predetermined time schedule ensures 

20 that at the moment of imaging, the article being imaged is correctly positioned relative to the imaging units. 

Fig. 15 is a pictorial illustration of an article in motion within the illumination and imaging apparatus of Figs. 
10-13 and a method for triggering the imaging units when the article in motion reaches a predetermined pos- 
ition along its trajectory. The method of Fig. 15 may be employed for triggering a high level of illumination or 
for triggering the imaging-for-analysis of the article in motion or for triggering any other system response. 

25 Optionally, one or more imaging unit digitizes a predetermined portion of its field of view generally contin- 

uously, whereas the remainder of the imaging units only digitize their fields of view upon triggering by the con- 
tinuously digitizing imaging unit The continuously digitzing imaging unit may trigger the remainder of the im- 
aging units either directly or via a central control mechanism such as a computer. The continuously digitizing 
imaging unit preferably digitizes at a relatively low resolution when digitizing in order to monitor article position 

30 and digitizes at a relatively high resolution when digitizing for analysis. 

When digitizing in order to monitor article position, the imaging unit preferably analyzes only a single col- 
umn or row of the field of view, such as a column close to the left boundary of the field of view, if the article 
enters the field of view from the left, or a row close to the top boundary of the field of view, if the article enters 
the field of view from the top. Preferably, a row or column which is near the relevant boundary but not so near 

35 as to be subject to edge effects, if present, is selected, such as the fourth row or column. Triggering occurs if 
a predetermined result is obtained from digitization of the monitored row or column in an individual frame, such 
as presence of at least ten consecutive pixels having reflectance values which differ from the reflectance val- 
ues of the same pixels in the previous frame. 

Fig. 15 shows the trajectory 330 of an object, which may have any shape such as a substantially straight 

40 line, in relation to the field of view 332 of an imaging unit (not shown), and three positions 340, 342 and 344 
of the object along the trajectory 330, which the object reaches at times t 1( t 2 and t 3 , respectively. At time t 1t 
the object is external to the field of view 332 and therefore, monitoring of the fourth column from the left, ref- 
erenced 346, of the field of view, will not result in triggering. At time t 2 , the object has reached a vertical location 
corresponding to the fourth column 346 of the field of view 332 and therefore, triggering will result in the time 

45 interval between t 2 and t 3 . At time t 3 , the object has reached the center 344 of the field of view of the imaging 
unit and is imaged for analysis by all imaging units (not shown). 

A particular feature of the method of Fig. 15 is that only a small portion of the field of view of the illumination 
and imaging apparatus, and only a small portion of the trajectory of the articles in motion, need be monitored. 
Also, only a single one of a plurality of imaging-for-analysis units need be employed in implementing the method 

50 of Fig. 15. The individual unit may trigger operation of the remaining units when the article to be imaged has 
been detected at the predetermined location along its trajectory. 

It is appreciated that the triggering method of Fig. 15 is suitable not only for triggering imaging units as 
shown. The triggering method of Fig. 15 has more general applications such as triggering a momentary high 
illumination level of an article which is normally illuminated at a low level. For example, a suitable level of ill u- 

55 mination for imaging fruit for analysis is approximately 3000 lux. A suitable level of illumination for imaging fruit 
merely in order to detect the time at which the fruit reaches a predetermined position along its trajectory is 
approximately 10 lux. 

Alternatively, the method of Fig. 15 for triggering a high level of illumination or for triggering the imaging- 
for-analysis of the article in motion or for triggering any other system response may be eliminated. Instead, a 
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time schedule for imaging articles may be implemented by a microswitch or by employing any other suitable 
device for physically sensing that the article in motion has reached a predetermined position along its trajec- 
tory, such as entry to enclosure 230 of Fig. 10. Micros witches must be delicate enough not to damage delicate 

5 articles such as fruit. 

Fig. 16 is a pictorial illustration of a sample configuration for a spectral standard useful in conjunction with 
the apparatus of Figs. 10-14, as described above with reference to Fig. 12. As explained above, each spectral 
standard is preferably utilized as an on-line internal reference to which each article may be compared, and 
thereby serves to standardize imaging over time by overcoming variations in optical conditions over time. 

10 As shown, the spectral standard may comprise a plurality of patches having different spectral bands. The 

patches may serve as standards for intensity and/or dynamic range and/or spectral content. A sample plurality 
of materials which may be cut to size in order to form patches suitable for inspecting apples includes the fol- 
lowing: 

1608: A white opaque diffuser formed of Alumina or BaS0 4 . 
is 1610: A neutral density filter having 3 db attenuation such as a GD-30-S. 

1612: A red filter such as a a CA-600. 
1614: A green filter such as a CA-550. 
1616: An IR filter such as an LG-697. 
1618: An IR filter such as an LG-790. 
20 1620: A black scatterer or black paint such as Krylon black enamel. 

All filters described above are commercially available from Corion Corp., MA, USA. 
Each patch may be approximately square in configuration with suitable dimensions such as 7 mm x 7 mm. 
However, the exact configuration of each patch is preferably not exactly square but rather curved so as to cor- 
respond to the curvature of the boundary of backgrounds 270 of Fig. 12. 
25 It is appreciated that the particular spectral bands and arrangement of spectral patches specified herei- 

nabove are merely exemplary and are not intended to be limiting. Selection of spectral patches is preferably 
determined by at least the type of article being graded, including variety of fruit if the article is a fruit, and the 
types of blemishes* and color variations to be detected. 

Fig. 1 7 is an optical schematic diagram, not to scale, of an individual camera unit 216 constructed and op- 
30 erathve in accordance with a preferred embodiment of the present invention. As shown, each camera unit pre- 
ferably comprises a monochromatic camera 320 such as a Model TC 655EC, commercially available from Burle 
Industries, Middlesex, England, an imaging lens 322, a spectral separation element 324 preferably including 
a prism as described in detail below, and an aperture 326. 

Camera 320 preferably has a spectral response in the visible and near-IR portions of the spectrum and 
35 is actuated by external triggering in accordance with a suitable method such as the method described herein 
with reference to Fig. 15. If high intensity continuous illumination is employed, a camera with a short duration 
shutter may be employed. 

Imaging lens 322 preferably comprises a high quality imaging lens with a relatively low F-number such as 
a P/N 71846, commercially available from JML Optical Industries, Inc., NY, USA, which has a focal length of 
40 12.5 mm and an F-number of 1.3. Spectral separation element 324 is operative to provide a plurality of non- 
overlapping subimages of each article, each subimage having different spectral characteristics. A preferred 
embodiment of spectral separation element 324 is described in detail below with reference to Fig. 18. 

Aperture 326 typically comprises a black panel having a central aperture whose diameter may be approx- 
imately 7 cm. Due to provision of aperture 326, the periphery of each subimage of the article is black, as best 
45 seen in Fig. 21 . Therefore, the plurality of subimages of each article typically do not cover one another despite 
a small amount of overlap therebetween. 

Reference is made briefly back to Fig. 10. Preferably, the optical path from the camera 320 to the imaging 
enclosure 230 of Fig. 10 is relatively long in order to provide a relatively small viewing angle such that a plurality 
of subimages of each article may be imaged. In order to provide a relatively long optical path without greatly 
50 enlarging the dimensions of housing 250, the optical path from camera 320 to enclosure 230 may be broken 
into path segments, such as path segments 330 and 332 of Fig. 10, which are optically associated with one 
another by means of mirrors (not shown). 

Figs. 18 and 19 are perspective and cross-sectional illustrations, respectively, of spectral splitting element 
324 of Fig. 17, constructed and operative in accordance with a first preferred embodiment of the present in- 
55 vention. As shown, the spectral splitting element preferably has a pyramid configuration comprising a plurality 
of facets such as 4 facets 360, 362, 364 and 366. The spectral splitting element of Figs. 18 and 19 is operative 
to provide 4 partially overlapping or nonoverlapping images. 

The spectral splitting element may be similar in construction to photographic multiple image elements such 
as Filter 201 of the Cokin Creative Filters System, commercially available from Cromofilter S. A., RC, Paris, 
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France, except that the pyramid need not be truncated at its top. 

A plurality of filters generally corresponding in number to the number of pyramid facets is operatively as- 
sociated with the pyramid facets. For example, two filters 380 and 382 are visible in Fig. 19 which are opera- 
5 tively associated with pyramid facets 360 and 364 respectively. Each filter may be attached by an adhesive 
or by any suitable mechanical means. The filters may be replaced or augmented by a dielectric or absorptive 
optical coating deposited on one or both surfaces 390 and 392 of each of the filters and/or deposited on one 
or more pyramid facets such as facets 360, 364 and 394. 

According to one preferred embodiment of the present invention, each filter and/or optical coating defines 
10 a spectral waveband which substantially do not overlap with the spectral waveband of any of the other filters. 
A sample set of 4 spectral profiles for 4 filters corresponding to the four facets of the pyramid of Fig. 4, which 
filters are particularly suitable for inspecting certain varieties of apples, is illustrated in Fig. 28. 

Fig. 20 is a perspective illustration of a spectral splitting element which is constructed and operative in ac- 
cordance with an alternative embodiment of the present invention. The spectral splitter of Fig. 20 is similar to 
15 the spectral splitter of Fig. 18 except that 6 facets are provided instead of 4, thereby providing 6 images of an 
article, each having different spectral characteristics. More generally, any suitable number of facets may be 
employed, depending on the number of differently characterized images required in a particular application. 

It is appreciated that the spectral splitting elements employed in the apparatus of the present invention 
need not be pyramidal in configuration, as shown in Figs. 18-20 which are merely exemplary of suitable spec- 
20 tral splitting elements. 

ft is appreciated that spectral splitting elements such as the spectral splitting elements illustrated in Figs. 
18-20 may be useful in a wide variety of contexts other than imaging agricultural produce, particularly appli- 
cations in which it is desired to capture an image of a fast moving article which is spectrally separated to a 
plurality of full relatively high resolution "subimages" thereof, as shown in Fig. 21. 
25 Fig. 21 is a pictorial illustration of an image generated by imaging an apple using the apparatus of Fig. 18. 

As shown, the image comprises four non-overlapping subimages 400, 402, 404 and 406, each of which may 
have different spectral characteristics. For example, subimage 400 may be red, subimage 404 may be green, 
subimage 406 may be IR and the waveband of subimage 402 may be a waveband which corresponds to the 
wavelength of light projector 218 of Fig. 10 and which substantially does not overlap the wavebands of sub- 
30 images 400, 404 and 406 as shown in detail below with reference to Fig. 28. 

Providing an IR image in combination with at least one colored image is particularly advantageous for fruit 
inspection because blemishes may effectively be detected by comparing the IR image of the fruit to the colored 
images thereof. 

It is appreciated that an image generated using the apparatus of Fig. 20 would include 6 subimages rather 
35 than 4 subimages as in Fig. 18. 

Each subimage preferably comprises an image 408 of an apple and an image 410 of a spectral standard, 
such as the spectral standard of Fig. 16, which serves as an internal reference for evaluating image 408. In 
subimage 402, the imaged apple 408 may be illuminated via a grid, as explained above. The image 412 of the 
grid is preferably a mask comprising a plurality of alternating dark and bright stripes. For example, the bright 
40 stripes may be approximately one-quarter the width of the dark stripes. 

As explained above, the four subimages are separated by a black region 414 due to provision of aperture 
326 of Fig. 17. 

Fig. 22 is an optical schematic diagram of a commercially available projector, the model 790 Xenon Arc 
lamp source, commercially available from Newport Corporation, CA, USA, which may be employed to imple- 
45 ment light projector 218 of Figs. 10 and 13, with the following modifications: 

Transmitting filters, such as an OG-580 and an RG-780, both commercially available from Schott, PA, USA, 
are placed adjacent the lamp assembly 498 and the projection lens 500 respectively. A grid slide comprising 
a black or opaque mask of stripes is placed adjacent the aperture plate 502. 

Reference is now made to Fig. 23 which is a simplified flowchart of a preferred method for implementing 
50 image processing unit 18 of Figs 1. Fig. 23 is described with reference to sorting and grading apples, specif- 
ically, however, it is appreciated that the method of Fig. 23 is generally appropriate for a wide variety of article 
inspection procedures. The method of Fig. 23, as specifically described below with reference to the Appen- 
dices, is suitable for an article inspection system which includes three imaging units, however, it is appreciated 
that the method may be suitably modified by the ordinarily skilled man of the art in order to apply to an article 
55 inspection system including any other number of cameras, such as four or more cameras. 
The method of Fig. 23 preferably comprises the following steps: 

Step 1808 : Set-up data is loaded into the system. Set-up data preferably includes the following items of 
information: 

a. Data regarding the position, relative to the cameras' field of view, of the element if any which supports 
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the article to be imaged, during imaging. For example, the set-up data may indicate whether or not cables 
supporting the article are visible by one of the cameras. 

If support elements are visible, data is preferably provided which identifies the location of support ele- 
ments. Preferably, each camera generates a binary mask for each subimage, using the following steps: 

i. All pixels are compared to a suitable threshold value, such as a gray level value of 100, thereby to 
define a binary mask. For example, pixels exceeding the threshold may be marked with a 0 gray level 
value, and pixels falling below the threshold may be marked with a 255 gray level value. 

ii. Adilation procedure is performed and then repeated on the binary mask in order to compensate for 
lateral movement of the cables or nets. 

Any conventional method for binary image dilation may be employed. 

b. Data regarding the spectral band and the location within the field of view of the camera, in camera co- 
ordinates, of each of a plurality of spectral patches to which each location of each article is compared. Suit- 
able pluralities of spectral patches are described above with reference to Fig. 16. 

c. Data identifying subimages to be analyzed. For example, the number of subimages to be analyzed may 
be specified as 4 and the 4 subimages may be identified as IR, red, green and grid subimages, where the 
grid subimage refers to the subimage in which the article to be imaged is illuminated through a grid. The 
first three subimages are collectively termed herein "the spectral subimages", and are used for size, shape, 
color and blemish categorizations. The subimage data preferably includes, for each camera, an indication 
of fixed offsets generated between subimages due to optical effects of the beam splitter. 
Alternatively, the grid subimage may be omitted or may be replaced by an additional IR subimage. The 

two IR subimages, also termed herein the "IR band I" and "IR band II" subimages, are useful in detecting blem- 
ishes as described below with reference to step 1830 of Fig. 1830. 

Step 1810: Optionally, profile data characterizing the variety of article to be inspected is loaded in image 
processing unit 18. For example, if the articles to be inspected are apples, substantially any variety of apple 
may preferably be processed, such as Red Delicious, Ida Red, Smith, Hermon, Golden Delicious, Mcintosh 
and Jonathan. Sample data for a profile of a particular variety may include the following: 

a. Definitions, preferably expressed as computational formulae, for each of a plurality of color gradings of 
a variety to be processed. » 

Color gradings may be based on accepted standards such as, for apples, the U.S.D.A. Standards for 
Grades of Apples. 

b. Definitions, preferably comprising a fuzzy logic expert system rule base, for each of a plurality of types 
of blemishes which occur in a particular variety to be processed. 

c. A computational formula for correcting the volume of the article, based on an assumption regarding the 
article in question, such as the assumption that the article is smoothly contoured or spherical. The cor- 
rection preferably is based upon more accurate knowledge of the shape of a typical article of the particular 
variety in question, relative to the assumed geometric shape of articles which are not classified by variety. 
A sample method for generating profile data for an undocumented type of article, such as a not-yet-profiled 

apple variety, is described below with reference to Fig. 26. 

Step 1812: A plurality of digitized subimages is received from each of the plurality of cameras in electro- 
optical imaging unit 16 of Fig. 1. In the present example, it is assumed that 3 cameras are employed, each 
providing 4 subimages, termed herein the red, green, IR and grid subimages, giving a total of 12 subimages 
of each apple of which 9 are spectral subimages and 3 are grid subimages. 

Step 1813: Since the four subimages are typically offset relative to one another, a suitable correction is 
preferably provided. Also, motion of the produce is compensated for. 

Step 1814: Each of the spectral subimages is corrected to compensate for uneven illumination or shading 
of the imaged apple, using any suitable method. A suitable shading correction algorithm is described in the 
following publication, the disclosure of which is incorporated herein by reference: 

Ballard, D. H. and Brown, C. M., Computer Vision , pp. 72 - 73, Prentice- Hal I, Englewood Cliffs, New Jersey, 
1982. 

Appendix A, when used in conjunction with Appendix B, is a computer listing of a software implementation 
of a preferred method for implementing steps 1813 and 1814 of Fig. 23. 
Step 1816: The boundaries of each of the 12 subimages are located. 

Step 1816 may be performed only once per camera per article, preferably on the green subimage provided 
by each camera or on a subimage generated by averaging the green and red subimages provided by each 
camera. Once identified, the boundary of the green subimage or of the green/red subimage for each camera 
is then modified in order to generate the boundaries of the remaining subimages provided by the same camera. 
Typically, a predetermined x-y shift is sufficient in order to obtain the boundary of the red, grid or IR subimages 
from the boundary of the green subimage from the same camera. 
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As explained above, set-up step 1808 preferably includes the step of loading, for each camera, an indica- 
tion of predetermined x-y shifts generated between subimages due to optical effects of the beam splitter. 

A representation of the boundary, in suitable form such as an XY list or in vector form, is stored in memory. 
5 Preferably, all steps from here on are performed only for pixels lying within the boundary as stored in mem- 

ory, in order to eliminate unnecessary computations. 

A suitable method for implementing step 1816 is described below with reference to Fig. 24 and Appendix 

C. 

Step 1818: For each pixel in the image of the article, the color of that pixel is determined. For example, 
10 the pixels within each of the spectral subimages may be compared to a spectral standard such as the spectral 
standard of Fig. 16. A particular advantage of performing this step by comparison to a spectral standard is that 
on-line comparison with a spectral standard placed within the same optical chamber used to image the apples 
cancels out errors due to temporal variations in the illumination of the interior of the optical chamber and due 
to dirt. 

15 Preferably, the spectral standard comprises a plurality of spectral patches, as illustrated in Fig. 16, each 

of which is assigned an identifying code. Each pixel within each of the spectral subimages is compared to the 
corresponding sub image of each of the plurality of spectral patches in order to identify the spectral patch whose 
subimage is closest in color or spectral characteristics to the subimage pixel. For example, if a brown color 
patch ts provided, a bruise location on an apple will normally be found to be closest in color to the brown color 

20 patch. The subimage pixel is then assigned the identifying code of that patch. 

A computer listing of a software implementation of a sample method for assigning identifying color codes 
to each of a plurality of locations in imaged StarKing apples which does not employ the method of comparison 
to a spectral standard is provided herein and is referenced Appendix D. 

Step 1820: The grid subimage generated by each camera may be analyzed in order to either identify stem 

25 and calyx locations or to identify an absence of stem or calyx in the portion of the article viewed by the camera. 
Preferably, one or more of the spectral subimages are also analyzed in order to facilitate identification of stem 
and calyx. A preferred method for implementing step 1820 is explained in more detail below with reference to 
Fig. 25. 

Optionally, if step 1836 below is includes in the method of Fig. 23, step 1820 may be eliminated. 
30 Step 1824: Each location along the apple surface Is preferably assigned to exactly one of the three cam- 

eras before the fruit feature computation step described below is carried out. 

According to one preferred embodiment of the present invention, predetermined portions of the article sur- 
face are assigned to each camera. in accordance with a predetermined model of the shape of the article, such 
as a sphere. 

35 A computer listing of a software implementation of a sample method for implementing step 1824, using a 

generally spherical model of the article, is provided herein and is referenced Appendix F. More specifically, 
the listing of Appendix F assumes that the cross sectional portion of the article corresponding to each line of 
the image is circular in shape. 

Preferably, an image of at least a portion of the article is compared to the predetermined model of the 

40 shape of the article in order to determine discrepancies between the actual shape of the article and the pre- 
determined model thereof. The determination of the predetermined portions of the article may then be cor- 
rected to take into account these discrepancies. 

According to an alternative embodiment of the present invention, subimages generated by adjacent cam- 
eras are compared in order to identify registration therebetween, which typically defines areas of overlap there- 

45 between. The overlap is taken into account such that each location is analyzed by taking into account only 
one image thereof generated by only one of the three cameras. Met hods for deter mining the relative alignment 
of two subimages are described in the following publication, the disclosure of which is incorporated herein by 
reference: 

Barnard, S. T. and Fischler, M. A., "Computational stereo", Computing Surveys, 14(4), 553 - 572, 1982. 
50 Preferably, step 1 824 comprises the step of identifying, for each of a majority of individual locations within 

an area of overlap between two camera units, the camera unit which images the individual location atthe small- 
est angle to a normal to the surface of the article at the individual location. 

Step 1828: The volume of the apple is computed, using any suitable method such as the following: 

a. Each of the imaging units may compute, for each line 1 of the image generated thereby, the distance 
55 di between a "begin article" point B and an "end article" point E, as shown in Fig. 27. 

b. For each line 1 , a value is computed as the product of the distance 6 A and a constant factor F which 
compensates for the fact that the imaging unit generally images less than half of the article. F may be 
computed by imaging a spherical article of known diameter and computing the ratio between the known 
diameter and the diameter of the imaged article. 
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c. For each imaging unit, an approximation to the volume of the apple in pixel units is computed, using the 
following formula: 

pi x sum t (Dt) 2 

5 d. For each imaging unit, the volume in pixel units computed in step c is converted to mm 3 by multiplying 

the value generated in step c by a scaling factor. 

e. The values generated in step c for each of the imaging units is averaged over imaging units to obtain 
an approximate value for the volume of the article in mm 3 . 

A software implementation of steps a - d for a three camera system is provided herein in Appendix F. 
10 In step 1830 , an image is generated by combining the IR band I and IR band II images so as to obtain 

differences therebetween. The image may be generated by dividing the IR band I image by the IR band II im- 
age, or by subtracting the IR band I image from the IR band II image. 

In step 1 832 , the image generated in step 1830 is inspected to identify blemish candidates which differ in 
appearance from the expected appearance of the apple. Specifically, contours for each discolored portion of 
15 the apple, also termed herein "blemish candidates", are identified. 

A commercially available chip which is suitable for identifying contours is the L64290 chip, commercially 
available from LSI Logic Corporation, Milpitas, CA, USA. Preferably, for each blemish candidate, features are 
recorded such as the area, perimeter, darkness inside the area, darkness outside the area and an aspect ratio, 
i.e. the ratio between the horizontal and vertical dimensions of the area. 
20 Appendix G is a computer listing of a software implementation of a preferred method for implementing 

steps 1830 and 1832 of Fig. 23. 

In step 1834 , each blemish candidate is fuzzy-logic processed so as to classify it as one of a plurality of 
blemish types such as russeting, bruise and bitter pit. 

Appendix H t taken together with Appendix I, is a computer listing of a software implementation of a pre- 
25 ferred method for implementing step 1834 of Fig. 23. 

Step 1836: The information regarding absence of or location of stem and calyx for each of the cameras, 
generated in step 1820, is combined over all cameras, in order to make a final identification of the locations 
of the stem and calyx. Preferably, the final identification of stem and calyx locations takes into account some 
or all of the following data: ♦ ? 

30 a. A comparison of the green, red and IR outputs of the stem and calyx locations to a predetermined dark 

color which is known to be characteristic of stems and calyxes. 

b. The shape of the fruit, such that an identification of a pair of stem and calyx locations which are not 
located along a central axis of the fruit, will be rejected. 

It is appreciated that the information regarding the locations of the stem and calyx may be utilized in per- 
35 forming subsequent operations on the fruit, such as cutting, marking and packing the fruit. 

Preferably, each of a plurality of pairs of blemish candidates is fuzzy-logic processed to identify one of the 
pairs of blemish candidates as including a stem and a calyx. Preferably, the results of step 1834 are employed 
to filter out blemish candidates which do not resemble stems and calyxes and therefore need not be fuzzy- 
logic processed. 

40 If three cameras are employed, the set of blemish candidates, each pair of which is fuzzy-logic processed 

in step 1836, preferably includes two "dummy" blemish candidates positioned at the two blind spots of the im- 
aging apparatus. Thereby, the system takes into account the possibility that the stem or calyx or both may be 
located at one or both of the two blind spots of the imaging apparatus. 

Optionally, if step 1820 above is included in the method of Fig. 23, step 1836 may be eliminated. 
45 Preferably, in step 1838 , the classification of blemishes is reviewed and modified to take into account the 

stem/calyx position as determined by step 1836. For example, a blemish candidate which was classified in 
step 1834 as russeting may now be reclassified as a non-blemish if it surrounds the stem position. 

As explained above, Appendix i includes a computer listing which, taken together with Appendix H, forms 
a computer listing of a software implementation of a preferred method for implementing step 1834 of Fig. 23. 
50 However, Appendix I also includes a computer listing of a software implementation of a preferred method for 
implementing steps 1836 and 1838 of Fig. 23. 

In step 1840 , the apples are graded based on the characteristics of the blemishes on each apple, as de- 
rived in steps 1832 and 1838. 

Fuzzy logic technology is discussed generally in the following publication, the disclosure of which is hereby 
55 incorporated by reference: 

Bezdek, J. C. and Sankar, K. Pal, Fuzzy models for pattern recognition , IEEE Pres 1992, ISBN 0-7803- 
0422-5. 

Commercially available development packages include TILShell together with FCDS (Fuzzy C Develop- 
ment System), commercially available from Togay InfraLogic, Irvine, CA, USA and the ADS 230 development 
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system, commercially available from American NeuraLogix Inc., Sanford, FA, USA. 

It is appreciated that the steps of the flowcharts described in the present specification need not be per- 
formed in the illustrated order and specifically, the steps of the method of Fig. 23 need not be performed in 
5 the illustrated order. For example, step 1818 may be performed after step 1824 in order to save computing 
time. Also, steps 1820 and 1826 may be performed in parallel to steps 1818 and 1824 or after steps 1818 and 
1824. Many other modifications of the illustrated order are possible. 

Reference is made briefly to Fig. 24 which is a simplified flowchart of a preferred method for implementing 
step 1816 of Fig. 23. A computer listing of a software implementation of a sample method for implementing 
10 the method of Fig. 24 is provided herein and is referenced Appendix C. 

Using the method of Fig. 24, the boundary of the apple may be found. In step 1850, at least one of the 
subimages of the apple is transformed into a binary image, comprising object pixels and background pixels, 
by a thresholding procedure. For example, if the pixels of the subimages are represented in 8 bits, a suitable 
threshold is a gray level of 200. Preferably, the green subimage is binarized because the green sub image has 
15 been found to differentiate well between the apple and its background. 

In step 1852, a filtering procedure Js employed to remove images of the support elements and artifactual 
images. The filtering procedure is operative to remove all portions of the image which are smaller than a se- 
lected filter. 

According to one alternative embodiment of the present invention, filtering is initially carried out using a 
20 first annular disc defining a one-pixel wide ring and the filtering procedure includes a single step in which, for 
each location within the image for which the one- pixel wide ring is not entirely covered by a no n- background 
entity, the entire portion of the image underlying the ring is removed. 

If the width of the support elements supporting the agricultural produce is 5 pixels, a suitable radius for 
the first annular filter is, for example, 6 pixels. 
25 Preferably, a second annular filter with a larger radius such as, for example, 20 pixels, is additionally em- 

ployed in order to round off edges left by the small radius filter. 

According to another alternative embodiment of the present invention, step 1852 is replaced by the step 
of employing a round disc filter. In this case, the filtering procedure includes two steps: an erosion step in which 
centers of portions which are smaller than the filter are removed; and a dilation step in which edges of large 
30 portions are restored, since these edges tend to be eroded in the erosion step. This embodiment may, for ex- 
ample, be implemented using a L64230 chip, commercially available from LSI Logic. 

Typically, there is a tradeoff bet ween the accuracy of the filtering operation which is achieved by employing 
a large filter, and between simplicity of computation which is achieved by employing a small filter. 

In step 1854, the coordinates of the apple boundary, typically cartesian coordinates, are identified. Typi- 
35 cally, the algorithm positions itself on the top line of the binary subimage. If no object pixel is encountered in 
the top line, the algorithm advances to and through the next line, and so on, until on a particular line, the first 
object pixel is encountered. When this occurs, the border pixels on the left and on the right for that line are 
identified and the algorithm then advances to the next line until a line is found on which, again, there are no 
object pixels. At this point, the boundary coordinates are stored (step 1866). 
40 Reference is now made to Fig. 25 which is a simplified flowchart of a preferred method, suitable for im- 

plementing step 1820 of Fig. 23, for analyzing a grid image generated by each camera in order to identify ab- 
sence of or location of stem and calyx. The grid image may comprise a grid of bright lines superimposed on a 
dark background. Before employing the method of Fig. 25, the edges of the bright lines may be sharpened by 
using any suitable method such as application of an edge-enhancement operator to the image. 
45 The method of step 1820 then generates, for each camera, an indication of a putative stem location or of 

an absence of stem, and an indication of a putative calyx location or of an absence of calyx. Locations are iden- 
tified as putative stem or calyx locations if the curvature of the grid lines, superimposed on those locations, 
changes relatively sharply thereat. 

A computer listing of a software implementation of a preferred method for implementing the method of 
50 Fig. 25 is appended hereto and is referenced Appendix E. 

Reference is now made to Fig. 26 which is a simplified flowchart of a method whereby a human operator 
"teaches" the system about an individual type of article, such as an individual variety of agricultural produce 
such as an apple variety, and the system generates profile data for the apple variety. 

The method of Fig. 26 preferably comprises the following steps: 
55 Step 1900: The learning process preferably takes place with illumination and other optical conditions that 

resemble operative conditions as closely as possible. 

Step 1902: Steps 1904, 1906 and 1908 are performed for each of a plurality of blemish types which it is 
desired to define. 

Step 1904: An article of the appropriate variety, such as an apple, is imaged. 
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Step 1906: A human operator identifies the location of a blemish within the image of the apple, using suit- 
able means such as a mouse. 

Step 1908: The system analyzes the spectral characteristics of the location indicated in step 1906. For 

5 example, the system may compare the color/spectral value of each of a plurality of pixels within the location 
indicated in step 1906, to the spectral patches of a spectral standard such as the spectral standard of Fig. 16, 
and identify the spectral patch that best characterizes the type of blemish under consideration. 

Steps 1910 - 1916: Each of a plurality of colors which characterize the apple variety, such as red, green 
and yellow, may be learned in steps similar to blemish learning steps 1902 - 1908 above. 

10 Reference is now made to Fig. 28 which includes four graphs 1 950, 1 952, 1 954 and 1 956 of spectral char- 

acteristics of the four filters of Fig. 18 respectively, for applications in which a projected light grid is employed 
in conjunction with filter 1956. For applications in which a projected light grid is not employed, the fourth filter, 
instead of having the spectral characteristics of graph 1956, may have the spectral characteristics of graph 
1957. According to one preferred embodiment of the present invention, the spectral profiles of the four filters 

15 are generally nonoverlapping. It is appreciated that the filters defined by the spectral characteristics of Fig. 
28 are merely exemplary of suitable filters. 

According to a preferred embodiment of the present invention, the four filters of Fig. 18 comprises a com- 
bination of filters, preferably including at least one IR filter, which is designed to facilitate distinction of bruised 
tissue from nonbruised tissue, as described below in detail with reference to Fig. 28. Reflectance spectra for 

20 bruised and non-bruised tissue are described in the following publication, the disclosure of which is incorpo- 
rated herein by reference: 

B. L. Upchurch et al, "Spectra photometric study of bruises on whole, red delicious apples", Transactions, 
of the ASAE, 33(2), March-ApriJ 1 990. 

Providing an IR filter is particularly advantageous for detecting blemished regions such.as russeting, sun- 
25 burn, rot and bruising on apples. ~ • 

Fig. 29 illustrates the conveying apparatus of Fig. 7 in operative association with the imaging apparatus 
of Fig. 10. It is appreciated that conveying apparatus constructed and operative in accordance with any of the 
~* embodiments shown and described herein may be similarly combined with imaging apparatus constructed and 
f operative in accordance with any of the embodiments shown and described herein. A particular feature of the 
30 apparatus of Fig. 29 is that only the elements, if any, directly supporting the article to be inspected, such as 
the nets and cables shown and described above, are disposed interiorly of the imaging enclosure and therefore 
there is relatively little obscuring of the article. 

Reference is now made to Fig. 30A which is a simplified side view illustration of singulating apparatus in- 
cluding a conveying junction 2098 comprising an interlaced pair of conveyors 2110 and 2160 suitable for con- 
35 veying agricultural produce such as apples. Conveyors 2110 and 2160 may replace conveyors 170 and 148, 
respectively, of Fig. 7. Alternatively, conveyors 2110 and 2160 may replace conveyor 170, only, of Fig. 7. 

The singulating apparatus of Fig. 30A receives non-singulated produce from a bulk conveyor 2100 which 
may comprise a conventional strip conveyor such as the strip conveyor commercially available from Matechet 
Rishon, Rishon Le Zion, Israel. The bulk conveyor 2100 feeds onto ascending singulating conveyor 2110. Pre- 
40 ferably, means are providing adjacent the junction between conveyors 2100 and 2110 for urging apples from 
conveyor 2100 onto conveyor 2110, such as a brush 2120. 

The singulator of Fig. 30A is also suitable for applications in which the ascending conveyor 2110 is partly 
submerged in water, and the non-singulated produce is provided within the water and is scooped up therefrom 
by ascending conveyor 2110, as explained above with reference to Fig. 3B. 
45 The ascending conveyor 2110 typically comprises a plurality of rotating roller assemblies 2130 which are 

mounted on a guiding chain or belt 2140 in operative association with a plurality of guiding pulleys such as 
pulleys 2150, 2152 and 2154. Ascending conveyor 2110 is preferably inclined so as to allow apples to roll or 
slide backwards into spacings between the roller assemblies 21 30. Rotation of the roller assemblies 21 30 need 
not be linked with the motion of the guiding chain 2140. 
50 Each roller assembly is configured for supporting an apple or other item of produce. Preferably, each roller 

assembly may be constructed as illustrated in detail in Fig. 30 B. 

Ascending conveyor 2110 interlaces with a cable conveyor 2160 including a plurality of cables such as 3 
or 4 cables which may, for example, be similar to the cable conveyor shown and described above with reference 
to Fig. 5. The cables may be formed of any suitable material such as rubber or polystyrene. Cable conveyor 
55 2160 is mounted on and driven on pulleys 2150, 2152, 2154, 2170 and 2180. In other words, cable conveyor 
2160 and ascending conveyor 2110 have guiding pulleys in common. 

Sample dimensions for the apparatus of Fig. 30A include: rollers: outer diameter — 5 cm, width — 6 cm, 
inter-roller spacing - 8 cm; brush: diameter - 25 cm; speed - 30 rpm; length of ascending conveyor - 50 cm; 
angle of ascending conveyor — 13 degrees; diameter of pulleys — 15 cm; apple conveying speed — 5 apple/sec. 
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It is appreciated that singulation of the produce in the produce inspection system shown and described 
herein may occur at any suitable point. Conveyor 2110 of Fig. 30A may be, but need not be, a singulator. If 
conveyor 2110 is not a singulator, the dimensions of the rollers 2130 thereof may be, for example, approxi- 
5 mately 2 cm, and the separation therebetween may be, for example, approximately 1 cm. Alternatively, rollers 
2130 may be eliminated. In this case, singulation of the produce is provided at the junction 2098 between con- 
veyors 2110 and 2160 by causing the velocity of conveyor 21 60 to exceed the velocity of conveyor 2110. For 
example, the velocities of conveyors 2110 and 2160 may be 40 cm/sec and 150 cm/sec, respectively. 

According to still a further alternative, singulation may not be performed by the apparatus of Fig. 30A. In- 
to stead, singulation may be performed by the apparatus of Fig. 32, as explained in detail below with reference 
to Fig. 32. 

Reference is now made to Fig. 30B which illustrates an individual one of roller assemblies 21 30, construct- 
ed and operative in accordance with one preferred embodiment of the present invention. Each roller assembly 
comprises a plurality of coaxial elements including article supporting discs 2170 defining a cradle 2172 for sup- 
15 porting an article such as an apple, cable supporting pulleys 2174 for supporting cables 2160 below cradle 
2172, and, preferably, spacers 2176. 

Article supporting discs 2170 may, for example, be formed of rubber and they may rotate at a suitable 
speed, such as 100 rpm, if it is desired to rotate the articles as they are conveyed. Cable supporting pulleys 
2174 may, for example, be formed of a suitable low-friction metal or plastic. Spacers 2176 may, for example, 
20 be formed of a suitable metal or plastic. 

It is appreciated that due to the configuration of Fig. 30B, the cables 2160 are below and spaced away 
from the apples being conveyed, until junction 2098 is reached, from which point the apples are supported by 
cables 2160. 

Figs. 31 A - 31 C illustrate apparatus for selectably ejecting apples from a cable conveyor 2200 into a se- 
25 lected one of a plurality of bins 2310 corresponding to a plurality of categories into which the apples have been 
categorized. Typically, apple categorization and control of the ejecting apparatus of Figs. 31 A- 31 C is by means 
of an automatic unit such as data analysis/ sorting/grading unit 20 of Fig. 1. 

The cable conveyor 2200 includes a plurality of cables such as 3, 4 or more cables. In the illustrated em- 
bodiment, the cable conveyor 2200 includes first, second and third cables 2210, 2220 and 2230. In Fig. 31 A, 
30 the produce is moving from left to right, as indicated by an arrow 2250. In Fig. 31 B, the produce is moving into 
the plane of the page. The rate at which the produce is conveyed is typically relatively high, such as 5 articles 
per second. 

The produce ejecting apparatus of Figs. 31 A - 31 C includes, opposite each of bins 2310, at least one kicker 
2240 and preferably a plurality of kickers, such as four kickers 2240, 2242, 2244 and 2246. Each kicker pre- 
35 ferably includes a rotating disc 2260 which is arranged such that its tangential velocity substantially equals 
the velocity of the moving produce, as indicated by arrow 2250. 

The magnitude of the velocity vector is preferably equal to the linear velocity of the produce, so as to pre- 
vent damage to the produce when engaged by the kicker. Disc 2260 may be formed of a soft rubber or plastic 
such as polyurethane. Sample dimensions for each disc 2260 are a diameter of 5 cm and a width of 2 cm. The 
40 separation between adjacent discs may be 6 cm center to center, or a 1 cm separation between perimeters. 

Each kicker is actuated by suitable means such as a solenoid or pneumatic piston 2270 which causes the 
kicker to pass smoothly between two extreme positions: a first inactive, withdrawn position, such as the pos- 
ition of kicker 2240 of Fig. 31 A, and a second active, protruding position, such as the position of kicker 2246 
of Figs. 31 A and 31 B. The amplitude of motion between the first and second positions is preferably 3 cm - 5 
45 cm. 

When a kicker is in its inactive, withdrawn position, it does not interfere with the passage of an item of 
produce along the cables 2200. When a kicker is in its active, protruding position, it protrudes between cables 
2220 and 2230 and engages a passing item of produce, acting to eject the item sideways, over cable 2210. 
Each kicker passes from its inactive position to its active position by extending along a direction indicated by 
50 an arrow 2280. 

In Fig. 31 A, a first apple 2290 is shown which is to be ejected and a second apple 2300 is shown, following 
the first apple, which is not to be ejected. Kicker 2240 is stationary, in its inactive position, since apple 2300 
is not to be ejected. Kicker 2242 is withdrawing after ejecting apple 2290, as indicated by arrow 2302, since 
apple 2300 is not to be ejected. Kicker 2244 is in its active position, since apple 2290 is to be ejected, and 
55 kicker 2246 is moving into its active position, as indicated by arrow 2280, in anticipation of the arrival of apple 
2290. 

It is appreciated that, if desired, bins may be placed on both sides of the cable conveyer. In this case, kick- 
ers corresponding to the bins on one side of the cable conveyor, such as bin 231 0, will protrude between cables 
2220 and 2230 when active, whereas kickers corresponding to the bins on the other side of the cable conveyor 
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will protrude between cables 2210 and 2230 when active. 

Fig. 32 illustrates a preferred alternative to the active conveying apparatus of Fig. 7 which is similar to the 
apparatus of Fig. 7 except that a cushioning element and brushes are provided to facilitate the transition of 
5 apples from one conveying device to another. Elements in Fig. 32 which are similar to corresponding elements 
in Fig. 7 bear identical reference numbers for convenience. 

In the illustrated embodiment, a cushioned landing pad 2190 is provided adjacent to and downstream of 
conveyor 170. The width W of the cushion 2190 is preferably relatively small, such as 2 cm, so that even articles 
which are not round tend to fall off the cushion 2190 toward a brush array comprising, in the illustrated em- 
10 bodiment, first and second brushes 2200 and 221 0. 

The first and second brushes 2200 and 2210 are provided upstream of cable conveyor 148, above and 
below cushioned landing pad 2190 or above and below a location slightly downstream of cushion 2190. A suit- 
able separation between the brushes is, for example, 2 cm. The highest point of lower brush 2210 is typically 
slightly elevated relative to the plane defined by cable conveyors 148, such as at an elevation of 1 cm relative 
15 to the plane of conveyors 148. The linear velocity of the brushes is typically equal to the linear velocity of cables 
148. 

During operation, apples are deposited from loading conveyor 170 onto the cushioned landing pad 2190 
from which they fall toward the brushes 2200 and 221 0. The brushes facilitate transfer of the apples onto driven 
cables 148. Preferably, brushes 2200 and 2210 accelerate the top and bottom portions, respectively, of the 

20 apples to a horizontal velocity suitable for conveyance along cables 148, such as 1 .2 m/sec. Brushes 2200 
and 2210 preferably place the articles onto cables 148, rather than rolling them thereon, such that the sepa- 
ration between apples on cables 148 is maintained because the apples do not roll therealong. 

It is appreciated that the brushes 2200 and 2210 may, alternatively, be replaced with functionally equiv- 
alent elements such as assemblies of soft plastic or rubber disks or sheets. 

25 Preferably, a decelerating assembly 2220 is provided for decelerating apples arriving from cables 148 and : 

facilitating the sequential transfer of these apples onto unloader 172. The decelerating assembly 2220 typically 
comprises a first brush 2230, a cable conveyor 2240, a pulley array 2250 for supporting and driving cable con- 
veyor 2240, a second brush 2260 and a third brush 2270. 

Cable conveyor 2240 may be approximately 60 cm long and comprise a plurality of rubber or polysterene 

30 cables which are typically thick relative to cables 148 and may, for example, have a cross-section of approx- 
imately 6 mm. The cables 2240 are associated with pulleys 2250 and are meshed or interlaced at their up- 
stream end with the downstream end of cables 148 and at their downstream end with the upstream end of 
unloader 172. The association between adjacent conveyors may be similar to that illustrated in Figs. 33Aand 
33B. The speed of the cable conveyor 2240 is preferably similar to the speed of unloader 172, such as ap- 

35 proximately 0.7 m/sec. The separation between the tips of brushes 2230 and 2260 is typically approximately 
2 cm. 

The operation of the decelerating assembly 2220 is as follows: The brush 2230 lifts an apple riding off 
cables 148 onto cable conveyor 2240, also decelarating the bottom portion of the apple to the speed of the 
cable conveyor 2240. 

40 Brush 2260 decelerates the upper portion of each apple so as to prevent it from rolling forward. In other 

words, the function of brush 2260 is substantially the reverse of the function of accelerating brush 2200. 
Brush 2270 cushions the apple as it is transferred from conveyor 2240 to conveyor 172. 
According to an alternative embodiment of the present invention, any of the various brushes in Fig. 32 
may be omitted. 

45 According to one alternative embodiment of the present invention, loading conveyor 170 conveys the ar- 

ticles in bulk and the articles are singulated in the course of being transferred to cables 148. For example, 
conveyor 170 may be a bulk conveyor, and a funnel may be provided upstream of cushioning pad 2190, such 
that the produce fall one at a time onto cushion 2190 and therefore are transferred one at a time onto cables 
148. Separation between produce may be provided by having conveyor 148 move much faster than does con- 

50 veyor 170. For example, the velocities of conveyors 148 and 170 may be 150 cm/sec and 40 cm/sec, respec- 
tively. 

Figs. 33A and 33B illustrate interlacing of cable 148 and associated pulleys 1 52; with cables 2240 and as- 
sociated pulleys 2250. As shown, conveyor 148 is angled relative to conveyor 2240, for example at a 5 degree 
angle, so that the apples do not come into contact with the pulleys. 
55 it is appreciated that a pair of meshed or interlaced cable conveyors such as those illustrated in Figs. 33A 

- 33B may be utilized more than once within a single produce sorting system and that one or more sequences 
of three, four or more pairs of interlaced cable conveyors may be provided within a single produce sorter. 

A computer listing of a software implementation of a preferred method for implementing steps 1824 and 
1828 of Fig. 23, is provided herein and is referenced Appendix F. The listing of Appendix F relies on a model 
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of object contour according to which the object under inspection is smoothly contoured. 

Appendix B includes a computer listing of a main program for an article inspecting system constructed and 
operative in accordance with a preferred embodiment of the present invention. 

Appendix J includes computer listings of helper routines useful in conjunction with the other computer list- 
ings appended hereto, as explained in more detail below. 

Appendix K includes computer listings of "include files" useful in conjunction with the other computer list- 
ings appended hereto, as explained in more detail below. 

A suitable environment for running the listings appended hereto is a 486 AT with 16 megabytes of memory, 
an Imaging Technology CFG frame grabber board, a PCL 720 digital I/O board, commercially available from 
Advantech, Taipei, Taiwan, and a color screen, the following software products being installed on the 486 AT: 

a. ITEX-CFG, commercially available from Imaging Technology, Boston, MA, USA; 

b. Fuzzy C Development System, commercially available from Togai Infralogic; and 

c. Microsoft C compiler, Version 6.00. 

The frame grabber board may be configured as follows: Base address — E0000, I/O address — 240. 
The PCL 720 board may be configured as follows: I/O address — 2A0. 

The electronic components diagrammed in Figs. 34Aand 34B may be built and connected to the above 
commercially available components and to Cohu Model 4912 cameras, commercially available from Cohu, San 
Diego, CA, USA, as shown in Figs. 34A and 34B. 

To load and operate any of the computer listings appended herewith, the following steps may be per- 
formed: 

a. Generate a computer file of the listing. At the top of each listing in each Appendix, a title appears which 
should be the name of the computer file. 

b. Use the batch file and DOS configuration file, a computer listing of which is appended herewith and is 
referenced Appendix L, to generate an executable program. 

It is appreciated that the various appendices enclosed herewith are merely intended to provide an extreme- 
ly detailed sample implementation of various preferred aspects of the present invention and are not intended 
to be limiting. 

It is appreciated that features of the present invention that have been described in combination with other 
features may also be employed separately wherever suitable and that features which have been described sep- 
arately may also be employed in combination with other features wherever suitable. For example, although 
the simultaneous inspection of generally all exposed areas of the inspected article is the preferred embodi- 
ment alternatively, a plurality of portions of the exposed area of the inspected article may be inspected se- 
quentially. 

The present invention is operative in the context of apple inspection and has been described in relation to 
apple inspection. However, it is appreciated that the invention shown and described herein has a wide variety 
of applications in inspecting other articles such as but not limited to agricultural products generally and delicate 
agricultural products specifically, and also to round or spherical objects generally. 

It will be appreciated by persons skilled in the art that the present invention is not limited to what has been 
particularly shown and described hereinabove. Rather, the scope of the present invention is defined only by 
the claims that follow: 

APPENDIX A 
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10 ID: 016 

File name is: appie.c 
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*/ 

* define Ql_IMAGE green 
^define Q2_IMAGE ir 
^define Q3_IMAGE grid 
15 * define Q4_IMAGE red 
# include "adapter .h" 
#include <stdio.h> 
# include <string.h> 

extern struct single_yiew_inf o view_inf o[N_CAMERAS ] ; 
struct (int y,x; > splitter^correction [ N_CAMERAS ] [ 4 ] = 

{ ( 0, 0, -2, 5, 6, 1, 5, 5 ), 

( 0, 0, 2, 7, 11, 2, 4, 8 }, 
{ 0, 0 f -5, 7, 9, 2, 7, 1 ) 

) 

static int dc_level[] = {22, 15, 22 }; 
^define I R_PLATE_F ACTOR 1.5 
^define GRID_PLATE_FACTOR 2.0 
#define GREEN^_PLATE_F ACTOR 1.5 - 
#def ine RED_PLATE_F ACTOR 1.5 
25 struct boundary_data pip_h; 

test_leading_field( image, cam) 

PIXEL image [L_FR_Y_SIZE] [ L_FR_X_SIZE] ; 

! . 
int c_x, c_y, s_x, s_y, yl., i ; 

swap_in( &pip_h, view_inf o[ cam] .xms_handle , (long) sizeof( struct boundary_dat 

view_inf o[ cam] .splitter [0] ) ; 

3Q c_x = (pip_h.out_rect.x2 + pip_h . out_rect . xl ) » 1; 

c_y = (pip_h.out_rect.y2 + pip_h . out_rect . yl ) » 1; 

s_x = c_x - L_FR_X_SIZE/2; 

s_y = c_y - L_FR_Y_SIZE/2; 

3ifdef _CFG 

cf g_2_ram ( image ,0,0, L_FR_Y_SIZE , L_FR_X_S IZE , s_x , s_y ) ; 

# end if 

for (i = 8 ; i < L_FR_Y SIZE ; ++i) { 

print f("\n %3d %3d",T, image [ i ] [L_FR_X_SIZE >> 1]); 
if (image[i][L_FR_X_SIZE » 1] < 200) break; 
> 

printf ( "\nend line: %d", (i+s_y)); 

if (i > 25) return (((i+s_y) & 1)); 
retum(((i+s_y) & 1)+1); 

) 

40 get_cam_splitter_images( image, cam, debugflag, process ing_mode , r_image, field) 
PIXEL image [L_FR Y_SIZE) [L_FR_X_SIZE] ; 
PIXEL r_image [ L_F~R_Y_S IZE ] [ L_FR_X_SI ZE ] ; 

( 

int j; 

double div_fact; 

set_channel(cam); 
for (j = 0 ; j < 4 ; ++j) 
< 

swap_in ( &pip_h , view_info[cam] .xms_handle, ( long) si zeof( struct boundary_dat 

view_inf o [ cam ] . spl itter [ j ] ) ; 
switch (j) { 
case 0: 

SWAP_IN_SIZE(r_image, cam, r_images.Ql_ IMAGE, L_FR_X_SIZE*L_FR_ 
div_fact = GREEN_PLATE_F ACTOR; 
50 break; 

case l: SWAP_IN_SIZE(r_image , cam, r_i mages . Q2_IMAGE , L_FR_X_SIZE*L_FR 
div_fact = IR_r»LATE_F ACTOR; 
break; 
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case 2: SWAP IN SIZE(r_image , cam, r_images . Q3_IMAGE , L_FR_X_SIZE*L_FR 
10 div_fact = GRID_PLATE_FACTOR; 

break; 

case 3: SWAP_IN_SIZE(r_image, cam, r_i mages. Q4_IMAGE , L_FR_X_SIZE*L_FR 
div_fact = RED_PLATE_F ACTOR; 
break; 

get|rect_nl( image, pip_h. boundary, pip_h . boundary_index , pip_h . outrect , 
15 splitter_correction[cam] [ j ] .x , 

splitter_correction[cam] [ j] .y, 
process ing_mode , field) ; 
l_shadow_norm( image , r_image , cam , divf act ) ; 

lf SWAp]]oUT_SIZE( image, cam, w_images . Q1_IMAGE , L_FR_Y_SIZE*L_FR_X_SIZE) 7 

elS SWAP_OUT2s i ZE( image, cam, w_images.Q2_IMAGE, L_FR_Y_S I Z E * L_FR_X_S I Z E ) 

elS SWAP_OUT_SIZE ( image , cam , w_images . Q3_IMAGE , L_FR_¥_S I Z E * L_FR_X_S I Z E ) ; 

elS SWAP_OUT_SIZE( image , cam, w_images . Q4_IMAGE , L_FR_ Y_S I Z E * L_FR_X_S I ZE ) ; 
if (debug_flag) 

draw boundary (pip h. boundary, pip h . boundary _index , 

- " pIp_h.out_rect, 0, 0, 251+ j, 254); 

) 

l_shadow_norm( image, ref_image, cam, factor) 

PIXEL *image, *ref_image; double factor; 

< 

unsigned int i; , 
double f, r; 

30 for (i = 0 ; i < (L_FR_X_SIZE * L_FR_Y_SIZE) ; ++i) 

1 if (*image > 253) { ++image; ++ref_image; continue; ) 

f= (double) ( * image - dc_level[cam] ) ; 

f= (double) ( *image - dc_level [ cam] ) ; 
r= (double) ( *ref_image - dc_level [ cam] ) ; 
r= r* factor; 
if (r < 1) r = 1.; 
35 f= f / r; 

f = f * 200 . ; 

if (f > 253. ) f » 253. ; 

★image = (PIXEL) ( f +0 . 5) ; 

++ image ; 

++ref _image ; 

) 

40 return ( 1 ) ; 

) 

static int sss = 1 ; 

get_rect_nl ( image , boundary, boundary_index , out_rect, off_x, off_y, 
processing_mode, field) 
PIXEL image[L_FR_Y_SIZE] [L_FK_X_SIZE] ; 
struct line_pair boundary [ ] ; 
A - struct rect out rect; 

45 , 

int c_x, c_y , s_x, s_y; 
char t[16]? 

c_x = (out_rect.x2 + out_rect.xl) » 1; 
c_y = (out_rect.y2 + out_rect.yl) » l; 
s x = c_x - L_FR_X_SIZE/2 + offx; 
S~y = c_y - L_FR_Y_SIZE/2+ of f_y; 
50 if (processing_mode == MANU AL_M0 D E ) 

get_block_dc ( image ,0,0, s_x , s_y ) ; 
else if (processing_mode == AUT0_M0DE) 

get_block_f ie Id 0_dc( image, 0,0, sx,s_y, field); 
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10 else { 

f printf (stderr , "Unknown P-mode M ); exit(l); 
} 

correct_pip_hole_n( image r boundary, boundary_index , s_x-off_x, s_y-off_y, out_ 

J 

get_block_f ield0_dc( image, k, 1, sj, s J/r field) 

PIXEL image[L_FR_Y_siZE] [L_FR_X_SIZE ] ; 

( 

15 Sdefine N_C 4 

int i,j, cam_col, cam_line, dc, p, a, b; 
PIXEL norms [N_C] [640] ; 
#ifdef CFG 

get_d~f ie Id (image, k,l, L_FR_Y_SIZE, L_FR_X_SIZE, s_x , s_y, field) ; 
gendif 

tfifdef NORM_M I DDLE__LI NE 
2Q get_block( norms ,k, 1, N_C, 640, 0, 2 28); 

cara_col = s_x; 

for (j = o ; j < L_FR_X_SIZ£ ; ++j) 
{ 

dc «= 0; 

for (a - cam_col-l ; a <= cam_col+2 ; ++a) 
for (b = 0 ; b < N_C ; ++b) 
dc += norms[b] [ a] ; 

25 dc - dc » 4; . 

for (i =0 ; i < L_FR_Y_SIZE ; +'+i) * 
{ 

p = image[i)[ j]; 

p = p-dc; 

if (p < 0) p = 0; 

imageCi][j] - (PIXEL)p; 

30 > 

++cam_col ; 

} 

#endif 
) 

get_block_dc ( image ,k,l, s_x , s_y ) 

PIXEL image[L_FR_Y_SIZE] [L_FR_X_SIZE] ; 

35 int i,j, cam_col , cam_line, dc, p, a,b; 
* define N_C 4 
PIXEL norms[N C][640]r 

ge t_b 1 ock ( Image , k , 1 , L_FR_Y_S I ZE , L_FR_X_S I ZE , s_x , s_y ) ; 
iifdef NORM_MIDDLE_LINE 

get_block( norms, 0,0, N_C, 640, 0, 2 28); 
cam_col - s_x; 
4Q for (j = 0 ; j < L_FR_X_SIZE ; ++j) 

dc - 0; 

for (a - cam_col-l ; a <= cam_col+2 ; ++a ) 
for (b = 0 ; b < N_C ; ++b) 
dc +« norms [ b ] [ a ] ; 
dc = dc » 4; 
if (dc > 60) 

45 printf ("\nDC: %d %d», dc, cam_col); 

for (i = 0 ; i < L_FR_Y_SIZE ; ++i) 
{ 

p = image[i][ j] ; 

p - p-dc; 

if (p < 0) p = 0; 

image[i][j] = ( pixel )p; 

50 ) 

++cam_col ; 

) 

iendif 
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correct f or_saturation ( image ) 

PIXEL image[L_FR_Y_SIZE] [L_FR_X_SIZE) ; 

< 

int i,j; 

for (i = 0 ; i < L_FR_Y_SIZE ; ++i) 
for (j = 0 ; j < L_FR_Y_SIZE ; ++j) 

if (image[i][ j} > 253) image[i]Cj] = 253; 

Xdraw boundary ( boundary , boundary_index , out_rect, off_x, off_y r bgcolor, rect_co 
struct line_pair boundary [ ] ; 
15 struct rect out_rect; 

( 

int i,xl,x2,y; 

for (i - 0 ; i < bound a ry_ index ; ++i ) 
{ 

y = boundary [ i J . y + off_y; 
xl - boundary [ i] .xl + offx; 
20 x2 = boundaryf i j -x2 + off_x; 

printf("\n +++ %d %d %d %d",i, y,xl,x2); if (x2 <= xl ) printf ( »+++•' ) ; 
wpixel(xl,y,b_color) ; 
wpixel(x2,y,b_color ) ; 

> 

if (rect_color >= 0) ( 
dline(out_rect.xl+off_x, out_rect .yl+of f_y , out_rect .x2+of f _x , out_rect . yl+o 
2S dline(out_rect.x2+off_x, out_rect. yl+of f __y , out_rect ,x2+of f_x, out_rect . y2+o 

dline(out_rect.x2+off_x, out_rect-y2+of f_y , out_rect.xl+of f_x , out_rect . y2+o 
dline(out_rect.xl+off_x, out_rect.y2+of f_y , out_rect .xl+of f_x, out_rect . yl+o 
) 
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/* ID: 015 

File name: appl5.c 



idefine REAL_GRAB 

^include "adapter. h" 

# include <stdio.h> 

I include <process.h> 

i include <io.h> 

i? include <conio.h> 

# include <time.h> 

£ include <string.h> 

fi include <math.h> 

£ include <setjmp.h> 

id e fine D_ST_CA 12 

^define D_ROT ^ 

iidefine D_MOTH 65 

^define D_LROT 101 

^define DJUJSSET 131 

^define D__BRUISE 161 

#define D_PIT 191 

^define D_PARLAT 220 

#define D NOTHING 241 

#def ine BLEMI SH^KI NDS_N 9 

extern jmp buf 3mp_mark; 

static int'line - 100, col = 30, 

static int display_index = l? . 

double apple_volume ; 

struct prog_settings proa consts, 

struct setup data settings, 

& olr^ef "I^le.red, veliow. Green, Orange, Sat; 

double dist = 80. ; 

PIXEL image2[FR_Y_SIZE][FR__X_SIZE3, 
struct boundary_data bnd; 
} memo ; 

Struct { iroa ge0[FR YJIZE][FR X SIZE]; 

PIXEL imagel[FR^Y SIZE] [ FR_X_SIZE ; 
PIXEL imaIe2[FRlYlSIZE][FR_X - SIZE]; 

' struct } c^dat ? candidates[MAX_CANDIDATES] ; 

int cand index; <„.*~ v . 

int n stems, stem_index, calyx_xndex , 

int global_color_grade, apple_size, 

int p_errno; 

int debug_flag; 

static char lastjcey[4]; 

char *args[16]; 

|K e xt(a, t , = ,d,e,£l wri t e_s t r(a, b ,c,d,e); 

EKE char *f text t ] - ( "Get Data", "Size", "Blemish", 

static I, :f te s x^"= ; ""••. —< " F7 "' " F8, 
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static struct { 
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int xs, ys f xf f yf; 
unsigned char on_off; 
int f color, b_color; 
char *act button, *text; 



} buttons [16] 
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Sifdef VGA 

static short screen lut [ 256 ] [ 4 ] ; 
#endif 

£ define DISP_X 640 
480 
0 
0 



^define DISP_Y 
i define GRAB_X 
^define GRAB_Y 
# define UP_ARROW 
#def ine R IGHT__ARROW 
# define DOWN_ARROW 
fldefine LEFT_ARROW 
#define HOME_KEY 
fdefine ENDKEY 
#def ine PgDn_KEY 
#define PgUp_KEY 
#define CTRL_F1_KEY 
# define CTRL_F8_KEY 
#define CTRL_F6_KEY 
fdefine ALT__F8_KEY 
#define F1_KEY 
#def ine F2_KEY 
# define F3_KEY 
#define F4_KEY 
#define F5_KEY 
#define F6_KEY . 
#define F7_KEY 
#define F8_KEY 
#define F9_KEY 
#define F10_KEY 
#define CNTRI^Z 
#define ESCAPE 
# define CNTRL_D 
#define HOME_HEY 
#define END_HEY 
fdefine BOT_20 
# define STARTJY 
#define END_Y 
#define Y_INCREMENT 
#define START_X 
#def ine END X 



#define X_INCREMENT 
#define D_X 
#define D_Y 
#ifdef IP8 

static short grab_lut[ 256] [ 4 ] ; 
static short screen_lut [ 256 ] [ 4 ] ; 
static short blank_lut [ 256 ] [ 4 ] ; 
#endif 

#define TEXT_X1 25 
^define TEXT_Y1 290 
#define TEXTJC2 615 
#define TEXT_Y2 360 
#define TEXT_BACK 176 
#define SHAD 5 

#define STAT_FILE_NAME "s_file.dat" 
FILE *stat_f in- 
struct { 

int size; 

int volume; 

int color index 1; 



1 
2 
3 
4 
5 
6 
7 
8 

40 

41 

99 
61 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 

71 
79 

( ( int ) ( DISP_Y / 5 ) ) 
( ( int ) ( DISP_Y - BOT_20 ) ) 

( (int) (DISP_Y - 1) ) 
( (int) ( (END_Y-START_Y)/2 +' 
10 

( (int) (DISP_X )) 
((int)(DISP_X / 4 + 2)) 
( ( int) ( X_INCREMENT*0 . 80 ) ) 
( (int) ( Y_INCREMENT*0.70) ) 
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int color_index_2; 
int color_index_3 ; 
int color_index_4 ; 
int n_rot; 
int n_bruise; 
int n_moth; 
int n_st_ca; 
} statistics; 

static char *apple_brands[ ] - {"Smith", "Hermon", "Ana", "Orleans", NUL 

int apple_brand; 
static int auto_mode ; 
int grade_l, grade_2; 

main(argc ,argv ) char *argv[ ] ; 

< 

int exit flag, ret, off_x, off_y; 

if (argc < 4) { printf("\n Usage: %s apple-brand debug auto" ,argv[ 0 ] ) ; exit(l) 
20 sp_init_xms( ) ; 

debug_flag = atoi(argv[ 2 ] ) ; 
auto_mode = atoi ( argv [ 3 ] ) ; 
init_statistics( ) ; 
init exception_handlers( ) ; 
reinTt_storage( ) ; 
25 process_command_f ile(SETUP_FILE, &prog_consts , ^settings); 

load_splitter locations( ) ; • 
load_no_zone_Tmages ( &memO ) ; 

if (debug_flag) show_setup( & settings ) ; 

apple_brand = match_apple brand ( argv [ 1 ]) ; 

if (apple brand < 0) { prTntf("\n Unfamiliar apple brand'!); exit(l); ) 
init_dispTay( ) ; 
# define SCREEN_COLOR 118 
# define TEXT_COLOR 255 
# define KEY_cOLOR 14 
#define SHADOW_COLOR 0 
#ifdef IP8 

load_luts( ) ; 

set_lut_active ( screen lut ) ; 
# end if 
#ifdef VGA 

initvga_display(5,2) ; 
load_luts( ) ; 

vga_clear_screen ( 7 ) ; 
vga_set_pallate( screen lut); 
#endif 

#ifndef TEXT_COLOR 
40 ^define TEXTCOLOR 255 
* define KEY_cOLOR 14 
^define SHADOW__COLOR 0 
jfendif 

2oom_window( 0 ) ; 
pan_window (0,0); 
demons creen( ) ; 
45 exit flag = 0 ; 

display_header (argv[ 1] ) ; 
if (auto_mode) ( 

do_auto_raode(argv[ 1] ) ; 

auto_mode = 0; 

} 

autocode = atoi ( argv[ 3 ] ) ; 
50 do { 

p_errno = 0; 

switch (select_menue( ) ) 

( 

case CTPX_F1_KEY: on_indicator ( "Fl" ) ; 
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#ifdef IPS 
#endif 

case F2_KEY 

case F3_KEY 

case F4_KEY 

case F5_KEY 
case F6_KEY 

case CTRL_F6_KEY 

case F7_KEY 

case CTRL_F8_KEY 

case ALT_F8_KEY 
case ESCAPE: 



case PgDn_KEY: 
case PgUp_KEY: 

case CNTRL 2: 



case CNTRL D: 



get_da ta_a 1 1 ( MANUALJ !ODE ) ; 
set_lut_active(screen_lut) ; 
break; 

on_indicator ( "F2" ) ; 

line = 100, col = 30; display_index = 1 
display_header(argv[ 1 ] ) ; 
do_measure_all( ) ; 
break; 

on_indicator( "F3") ; 
bruise_all ( ) ; 
break; 

on_indicator( "F4") ; 
do_global_all( ) ; 
break; 

on_indicator( "F5 M ) ; 
break ; 

on_indicator( "F6") ; 

pr oduce_3d_f i le ( F I LE_ 3 D_N AME ) ; 
break ; 

on_indicator( "F6 M ) ; 
do_save_data(memO . imageO) ; 
break; 

on^indicatorf "F7" ) ; 
wrTte_statistics ( ) ; 
break; 

: on_indicator( "F8" ) ; 
if (wait_f or apple( ) ) 

extrac t_regions_all ( AUT0_M0DE ) ; 

break; 

do_calibrate_all ( ) ; 
break ; 

exit_flag = 1; 
break; 



break ; 

auto_mode = 0; 
break ; 

auto_mode = 1; 
do_auto_mode ( argv [ 1 ] ) ; 
break ; 



of f_indicator ( last_key ) ; 
) while (!exit_flag) ; 
#ifdef IPS 

set_lut_active(grab_lut) ; 
#endif 
#ifdef VGA 

fin it vga ( ) ; 
tfendif 
J 

static int off_x, off_y; 
toggle_display_image( ) 
{ 

int off_x, off_y; 

++display_index ; 

if (display index > 2) display_index = 0; 

of f _x = a to! ( prog_cons ts . T_WIN_X_0FF [ CAM_2 ] ) ; 
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of f_y = atoi ( prog^consts . T_WIN Y_OFF[ CAM_2 ] ) ; 

10 if (display_Index == 0) dTsplaycamf ull ( CAM_1 , off_x, off_y); 

else if (display_index = l) display_cam_f ull ( CAM_2 , off_x, of f_y) ; 

else if (displayindex = 2) display_cam_f ull(CAM_3 , of fx, off~y); 

do_auto_mode ( brand ) char *brand; 

{ 

int ret, of fx, off_y; 
15 do < 

vga_f illed_rec tangle (7+4 , 7+4, 7+10, 7+10, 90); 
p_errno = 0; 
on_indicator( "F8") ; 
more_wait : ; 

if ( wait_for_apple( ) ) 

extract_regions_all ( AUTO_MODE ) ; 
on if (kbhit()) ( ret=getch(); 

* v if (kbhit()) { ret = getch(); 

if (ret = 81 | | ret ==73) { 

goto more_wait; } 
if (ret == 71 ) { 
goto morejwait; } 
if (ret ==CTRL_F6_KEY ) { 

on_indicator( "Fe") ; 
25 do_save_data ( meraO . imageO ) ; 

on_indicator( "F8" ) ; 
goto more wait; 

} . 
else continue; ; : ; 

else break? , - • 



30 if (kbhitO) break; 

#ifdef FOR DATA TAKING 



on_indicator( "F6") ; 
do_save_data (memO . imageO ) ; 
on_indicator( "FB" ) ; 



35 



Ifelse 

on_indicator ( "F2" ) ; 

display_header ( brand ) ; 
line = 100, col = 30; display__index = 1; 
ret = do_measure_all( ) ; 
if (ret J= SUCCESS) continue; 
if (kbhit()) break; 
on_indicator( "F3" ) ; 
bruise_all( ) ; 
40 if (kbhit()) break; 

on_indicator( M F4 " ) ; 

do^global_all( ) ; 
on_indTcator ( "F6" ) ; 
write_statistics{ ) ; 
do_save_data ( memO . imageO ) ; 
produce 3d file (FILE 3D NAME) ; 
#endif ~" ~ ~ 

} while (!kbhit()); 
of f_indicator(last_key ) ; 
while (kbhit{ ) ) getch( ) ; 

vga_filled_rectangle(7+4 , 7+4, 7+10, 7+10, 0); 

> 

bruise_all( ) 
( 

int cam, count, ca_index, mate_index, cam_dist, third_index; 
int old_chan, cam_i; 

int cam_redirection[] = { 0, l, 2 ); 
old_chan = get_channel ( ) ; 
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spots_index = 0; 

for (cain_i = 0 ; cam_i < N_CAMERAS ; ++cam_i ) { 
cam = cam_redirection[cam_i ] ; 
set_channel(cara) ; 
count = do^bruse l(cam, &mem0.bnd, 
memO.TmageO , 
memo. image 1 , 
memo. image 2 , 

meml . imageO , 
raeml. image 1 , 
15 meml. image 2 , 

spots ) ; 

spots_index += convert_spots ( spots , &f inal_spots[ spots_index] , count)? 
SWAP_OUT_SIZE(meml . iraagel , cam, spots_2 , FR__Y_SIZE*FR__X_SIZE ) ; 
if (cam == CAM_2 ) 

display single_object( meml . imagel , BRUSE MARK , 0, 
2Q atoI( prog_consts . T_WIN_X_OFF [ 1 ) ) , atoX< prog_consts . T_WIN_Y_OFF[ 1 ] ) 

* else if (debug_flag || iauto_mode) 

display single_ob ject ( meml . imagel , BRUSE_MARK , 0 , 

atoT( prog_consts . T_WIN_X_OFF [ cam ] ) , atoi ( prog_consts . T_WIN_Y__OFF [ c 

) 

if (debug_f lag) { 

printf ( "\n3-D data:"); 
25 printf ( »\n========" ) ; 

display_f ound_contours (f inal_spots , spots_index, &memO . imagel ) ; 
) 

cam_dist = prog consts . earner a_di stance [ CAM_1 ] ; 
spots_index = fTll_3d_inf o(f inal__spots, spots__index , 

&mem0 . bnd , &mem0 . image 0 , &memO . imagel , 0 ) ; 
ca_index = choosers tem_ca 1 yx ( f inal_spots , spots_index , 0 ) ; 
30 if (ca_index >= o ) { 

mate_index = f inal_spots[ca_index] .mate; 
printf ( "\nlooking for third" ) ; 
third_index = look_f or_third( f inal_spots, 

spots_index, ca_index, mate_index); 

J 

else { 

35 ca_index = third_index = mate_index — -1; 

) 

printf ( "\nfound : ca_index= %d mate_index= %d third_index= %d" , 

ca_index , mate^index , third_index ) ; 
pre_re_c lass ify ( final_s pots, spots_index, &ca_index, &mate_index, &third_index 
re_classif y(f inal_spots , spots_index, ca_index, mate_index r third_index) ; 
cancel_no_zone_litter ( f inalspots , spots_index, &memO ) ; 

if (dump_spots( "F_SPT.DAT" , final_spots, sizeof ( struct spot) * MAX FINAL SPOTS 
{ 

printf ("\n ERROR : dump final spots failure"); 

exit(l) ; 

> 

if (debug_flag && ca_index >= 0) { 
^ if (f inal_spots[ca_index] .f lag4 == REAL_BLEMISH) 

display_single( &f inal_spots[ca_index] , 254, ca_index) ; 
if (f inal_spots[mate index ].flag4 = REAL_BLEMISH) 

display_single(&fTnal_spots[mate_index] , 254, mate_index); 
if (third index >= 0) 

if (fTnal_spots[third_index] . f lag4 == REAL_BLEMISH) 

display_single( &f inal__spots [ third_index ] , 254, mate index); 

50 > 

f ill_blem_stat (f inal_spots , spots_index, 

ca_index, mate_index, third_index ) ,- 

display_f ound_contours_on ( f inal_spots , spots_index , 

ca_index, mate_index, third__index ) ; 

if (ca_index >= 0) { 

if ( f inal_spots [ caindex ] . f lag4 — REALBLEMISH) 

55 



40 



35 




36 



EP 0 566 397 A2 



10 



15 



20 
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struct spot *spot; 



int off_x, off_y? 
char name [ 16 ] ; 

if ( ( !debug_f lag && auto_mode) && spot->cam_number I- CAM 2) return(l) ; 
switch ( spot->cam_number ) 



case 0 : 



case 1: 



case 2 : 



of f x = 
off_y > 
break ; 

offx • 
off_y = 
break; 

off_x = 
off_y = 
break; 



atoi ( prog_consts . T_WIN_X_OFF [ CAM_1 ] ) j 
atoi ( prog_consts . T_win_y_off [ cam_1 ] ) ; 



atoi ( prog_consts . t_win_x_off [ cam_2 ] ) ; 
atoi (prog_consts . T_WIN_Y_OFF[ CAM_2 ] ) ; 



atoi ( prog_consts . T_WIN_X_OFF[ CAM_3 ] ) ; 
atoi ( prog_consts . T_WlN_Y_OFF[ CAM_3 ] ) ; 
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draw_contour_f ile_on(spot, spot->flag3, color, spot->cam_number , 

1, off_x, off y); 

J 

draw_contour_f ile_on(spot, id, color, cam_number, magni, off_x, off__y) 
struct spot *spot; 

( 

int j, ret, per, i; 

char c_narae [ 24 ] ; 

#define CHAIN_SIZE 204 8 

char chain[CHAIN_SIZE] , *p; 

int xybuf [1024 J[ 2] ; 

int min_i # min_ j , max_i , max_ j ; 

# define _UP_ARROW 'U' 

^define _DOWN_ARROW 1 D • 

# define _LEFT_ARROW 1 L * 

#define _RIGHT_ARROW *R» 

sprintf (c_name , M %s%ld_%ld. cnt" , TMP_DEVICE, caro_number , id); 

ret = undump_spots ( c_name , chain, CHAIN_SI2E, &per); 

if (ret != SUCCESS) { 

printf ( "\nContour file %s not found", c name)? retum(l); 

) 

i - spot- >s tar t_i + off_y; 
j « spot->start_j + off_x; 

chain_to_raster(i , j, chain, xybuf, &min_i, &min_j, &max_i , &raax_j); 
plot_buf_on ( xybuf , per, color, 1, 5); 
Sifdef OLD 

for (p = chain; *p ; ++p) 
{ 

switch( *p) 
( 

case _UP_ARROW: — i ; break; 

case _DOWN_ARROW: ++i ; break ; 

case _LEFT_ARROW: — j; break; 

case __RIGHT_ARROW : +-rj ; break; 



} 

£endif 



wpixel_demo( j,i, color) j 



50 



plot_buf _on ( circle_buf , buf _pointer , color , magni , smooth_d ) 
int circle_buf [ ] [ 2 ] ; 

{ 

int i; 

int k,l, il , j ; 
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float dividorl = ( smooth_d*2 . +1 ) / ( float )magni ; 
float dividor2 = ( smoothed* 2 . +1 ) / ( float )magni ; 

if (buf_pointer < smooth_d ) { buf_pointer = 0 ; return(O); } 
k = 1 = 0; 

for (i = -smooth_d ; i <= smooth_d ; ++i ) 
{ 

if ( i < 0 ) j - buf_pointer+i ; else j = i; 
k += circle_buf [ j ] [ 0 ] ; 
1 += circle_buf [ j } [ 1 ] ; 

) 

1 = (int) ( (float )l/dividorl) + 0; 
k = (int) ( (float )k/dividor2) + 0; 
wpixel_demo(l,k, color) ; 

for (il = 1 ; il <= buf_pointer ; ++il) 
{ 

k = 1 = 0; 

20 for (i=il -smoothed ; i <= il+smooth_d ; ++i ) 

{ 

if ( i<0 ) j = buf_pointer+i ; 

else if (i >= buf_pointer ) j = i-buf ^pointer ; 
else j = i; 

k += circlebuf [ j][0] ; 1 += circle_buf [ j ] [ 1 ] ; 

) 

25 1 = (int) ( (float) 1/dividorl) + 0; 

k = (int) ( (float)k/dividor2) +0; 
wpixel_demo( 1 r k, color ) ; 

} 

• buf _pointer *= 0 ; ' X ' * 

return ( l ) r * 1 • " 
} 

30 produce_3d_f ile(name) char *name; 

{ 

char *p; 

char namel [32]; 

double t volume; 

int fill color_mask( ) ; 

int spt_Tndex ; 

35 if (undump_spots( "F_SPT.DAT" , final_spots, sizeof ( f inalspots ) , 

&spt_index) = FAILURE) 
( printf( M \n Final_spots file not found"); exit(l); ) 
spots_index=spt_index ; 

f ill_color_mask( f inal_spots , spt_index , memo . imageO ) ; 
p = &mem0 . image0[0] [ 0] ; 
p += sizeof (struct boundary_data ) ; 
40 if ( strlen( settings .demo_file_comraand) > 0) 

sprintf ( namel , " %s " , name ) ; 
else strcpy( namel , name); 
printf("\n #DNAME: %s M , namel); 

do_3dfile( namel, (struct boundary_data *)&mem0.bnd, 
( struct boundary _data * ) &mem0 . image 0 , 
(PIXEL *)p, 

4- memo. imagel, memo . image2 , meml . imagel ,meml . imageO , &t volume); 

printf(*'\n Volume : %4d cc\n" , ( int ) ( t_volume/1000 . ) ) ; 

) 

display_cam_full(cam, off_x r off y) 
< 

switch (apple_brand) { 
case SMITHJTYPE: 

SWAP_IN_SIZE ( meml . imagel, cam, normal images . green , FR Y SI2E*FR X SIZ 

50 break; ~ 

case HERMONJTYPE: 
case ORLEANS JTYPE : 

SWAP_IN_SIZE ( meml . imagel , cam, norma l_i mages . red , FR_Y_SIZE*FR X SIZE) 
break ; 
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) 

SWAP_IN_S I ZE( memo . imageO, cam, enhanced_images .green , FR_Y SI2E*FR X SIZE); 

10 show_squeesed_image(memO. imageO, "O", off_x, off_y); 

SWAP_IN_SIZE(meml. image 1, cam, stem_mask, FR_YSIZE*FR_X_SIZE) ; 
^ display_single_object(meml.imagel, CALYX_MARK, O, off_x, off_y, 118); 

colect_color_inf ( cam_number , Dark__Red , Simple_red , Yellow , Green , Orange , Sat , changes n 
int cam_number; 

long *Dark_Red , *Simple_red , *Yellow , *Green , *Orange , *Sat , *changes , *no color; 

15 t ~ 
int display_flag = 1; 

SWAP_IN_SIZE( &mem0.bnd, cara_number, bnd, sizeof ( struct boundary data ) ) ; 
SWAP_IN_SIZE(memO . imageO , cam_number, raw_images . green, FR_X SIZE - * FR YSI 
SWAP_IN_SI ZE( memo. image 1, cam_number, raw_images . red , FR X~SIZE * FR~~Y~"SI 
SWAP_IN_SIZE(mem0. image2, cam_number, raw_images .grid , FR X SIZE * FR Y S 
global_color_analysis(cam_nuraber , &memO . bnd , memo . imageO r mera07imagel , meiiioTi 
20 m > Dark_Red , Simple_red , Yel low , Green , Orange , Sat , changes , n 

^ SWAP_OuT_SIZE(meml.imageO, cam_number, spots_l , FR_Y_SIZE*FR_X_SIZE) ; 

int do_global all() 
< 

int P 2; 
char tmp(64]; 
25 long changes=0 , no_color=0 ; 

float tmporal; 
Dark_Red=0 ; Simple_red=0 ; 
Yellow=0; Green=0; Orange=0; Sat=0 ; 

colect_color_inf ( CAM_i , &Dark_Red, &Simple_red, &Yellow, screen , &Orange, &Sat , &chan 
colect_color_inf ( CAM_2 , SDarkRed , &Simple_red , & Yellow, screen , iOrange , &Sat , &chan 
colect_color_inf ( CAM_3 , &Dark_Red , &Simple_red , fiYellow, &Green , SOrange , &Sat , &chan 
30 lf (aebug_flag) printf ( "\n\n COLOR ANALYSIS RESULTS pixel counters -\ 

\n Green=%ld dark_red=%ld simple_red=%ld Yellow=%ld Orange=%ld 

\n Sat=%ld Changes=%ld no_color=%ld" , 

Green, Dark_Red,Siraple_red , Yellow, Orange, Sat, changes, no color) ; 
changes = (long) (100 * changes/ ( float) (Dark_Red + Simple red +1) + 0.5); 
tmporal=(f loat) ( Da rk_Red+ Simp leered + Yell ow+Gre en 4-Orange + no color)* - 
Simple_red=(long) ( 100 . *Simple_red/tmporal +0 . 5) ; ~ 
35 Dark_Red=( long ) ( 100 . * Da rk_Red/ tmporal +0.5); 

Green=( long ) ( 100 . *Green/tmporal +0.5); 
Orange=(long) ( 100 . * Orange/ tmporal +0.5); 
Yellow=(long)( 100 .* Yel low/ tmporal +0.5); 
no_color=(long) ( 100 . *no_co lor /tmporal +0.5); 
if (debug_flag) printf ("\n\n NORMALIZED COLOR ANALYSIS : \ 

\n Green=%ld dark_red=%ld simple_red=%ld Yellow=%ld Orange=%ld 
40 \n Sat=%ld Changes=%ld no_color=%ld" , 

Green ,Dark_Red,Simple_red, Yellow, Orange, Sat, changes, no color); 
switch (apple brand) 

( 

case SMITH_TYPE: 
{ 

p2 = Green; 
45 p2=(p2<5)?5:p2; 

p2=(p2>95)?95:p2; 

sprintf(tmp, "Green Coverage"); offx = 60; off y = 200- 
make_rouler_p(of fx, off_y, off x+160, off y+20T 
20, p2, tmp, 57, 38); ~ ~ 

return ( 0 ) ; 
break ; 

50 ) 

case ANA_TYPE; 
case HERMON_TYPE : 
case ORLEANS_TYPE: 
{ 

p2 = Da rk_Red+Simple_red + (Orange»l); 
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p2=(p2<5)?5:p2; 
p2=(p2>95)?95:p2; 

sprintf ( tmp, "Red Coverage"); off_x = 60; off_y - 200; 
make_rouler_p(of f_x , off_y, off_x4-i60, off_y+20, 

20, p2, tmp, 57, 38); 
statistics . color_index_l = p2; 

p2 = Dark_Red ; 
p2=(p2<5)?5:p2; 
p2=(p2>95)?95:p2; 

sprintf (tmp, "Red Saturation Area"); off_x = 60; off_y = 240; 
make_rouler_p(of f_x, off_y, off_x+160, off_y+20, 

20, p2, tmp, 57, 38); 
statistics .color_index_2 = p2; 
p2 = Sat; 
p2=(p2<5)?5:p2; 
p2=(p2>95)?95:p2; 

20 sprintf (tmp, "Saturation Strength"); off_x = 260; off_y = 200; 

^ make_rouler_p(of f_x, off_y, off_x+160, off_y+20, 

20 , p2 , tmp , 57 , 38 ) ; 
statistics . color_index_3 = p2; 
p2 = changes; 
p2=(p2<5)?5:p2; 
p2=(p2>95)?95:p2; 

sprintf ( tmp , "Stripeness" ) ; off_x = 260; off_y = 240; 
make_rouler_p(of f_x, off_y, offx+160, off_y+20, 

20, p2, tmp, 57, 38); 
statistics. color_index_4 - p2; 

) 

} 

> 

20 get-_data_all (f lag ) 
{ 

int ret, old, cam_nuraber r 

zoom_window( 0 ) ; 
Sifdef CFG 

set_dac_limits_all (prog_consts .dac__low_lim[CAM_l ] , 
prog_consts.dac_high lim[CAM_l], 
35 prog_consts . dac low_Tim [ CAM_2 ] , 

prog_consts.dac_high_lim[CAM_2] , 
prog_consts . dac_low_lim[ CAM_3 ] , 
prog_consts . dac_high_lim[ CAM_3 ] ) ; 

£ end if 

Sifdef REAL_GRAB 
cont_grab(0) ; 
40 while ( !kbhit( ) ) ; if (getch( ) ==27) { 

f reese ( ) ; return ( 1 ) ; ) 

snap ( 0 ) ; 
£endif 

old = get_channel( ) ; 
extract_regions_all(f lag) ; 
set_channel(old) ; 

45 ) 

v/ait_for_apple( ) 
{ 

int ret; 
#ifdef __CFG 

set_dac_liraits_all (prog_consts . dac_low_lim[ CAM_1 ] , 
prog_consts . dac_high_l im [ CAM_1 j , 
50 prog_consts . dac_low_lim[CAM_2 ] , 

prog_consts - dac_high_lim[ cam__2 ] , 
prog_consts . dac_low_lim [ CAM_3 ] , 
prog_consts .dac_high_lim[CAM_3 ] ) ; 
ret = grab_moving apple ( prog_consts . apple^travel_time_interval , 
prog_consts . f rame_time_Tnterval , 0 ) ; 
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return (ret ) ; 

sendif 
10 return ( 0 ) ; 

} 

extract_regions_all(processing_mode ) 
{ 

int ret, cam_number , field; 
static int count = 0; 
char tl[4J; 

75 field = test_leading_f ield(&mem0, CAM_1) ; 

printf ("\nfield: %d", field); 

for (cam_number = 0 ; cam number < 3 ; ++cam_number ) 
( 

set_channel ( cam_number ) ; 

get_cam_spl i tter_images ( &memO , can_number , 

debug_flag, processing_mode , &meml , field) ; 

20 > 

return ( SUCCESS ) ; 

) 

do_calibrate_all( ) 
{ 

f printf (stderr , "\nThis option exists as a utility program only"); 

) 

25 zero_all_mask.s( image) PIXEL * image; 

< 

int cam; 

clear_mat( image) ; 

for (cam = 0 ; cam < N_cameras ; ++cam) 
{ 

SWAP_OUT_SIZE ( image , cam , spots_l , FR_Y_SIZE*FR_X_SIZE ) ; 
30 SWAP_OUT_SIZE( image, cam, spots_2, FR_Y_SIZE*FR_X_SIZE) ; 

SWAP_OUT_SIZE(image, cam, combi_map, FR_Y SIZE*FR_X_SIZE) ; 

) 

) 

do_measure_all( ) 

{ 

int precent, i; 

35 int mean [ N_CAMERAS ] , mad [ N_CAMERAS ] , min [ N_CAMERAS ] , max [ N_CAMERAS ] ; 
int mean_mean, mean_mad; 

if (p_errno == 0) test_f or_miss_f eed (apple_brand , memo . imageO ) ; 
printf ("\n -1)) bef or normal_f or . . . " ) ; 
for (i = 0 ; i < NCAMERAS ; ++i) 
( 

if (p_ermo = 0) 
40 do_measure ( i , &mem0 , &meml , meml . imageO , meml . image 1 , 

&raem0 . bnd , 50 , 

&mean[i], &mad[i], &min(i], &max[i], 
meml - image 2 , apple_brand ) ; 
if (p_errno) ( displayerror ( "Error : Apple Miss Feed"); 
return ( FAILURE ) ; 

> 

45 normal_for_shadows(i , memO.imagel, mem0.image2, meml. imageO, meml . image 1 , 

SmemO . bnd ) ; 

) 

printf ( "\n 0 ) ) after normal_for. . . " ) ; 
mean_mean = mean_mad = 0; 
for (i = 0 ; i < N_CAMERAS ; ++i) 
( 

50 mean_mean += mean[i]; 

mean_mad -f = mad [ i ] ; 
} 

mean_mean = ( int )( (double )mean_raean / N_CAMERAS + 0.5); 
raean_mad = ( int )( (double )mean_mad / N_CAMERAS + 0.5); 

if (idebug_flag && autocode) display_in_auto_mode(mean_mean , mean_mad); 
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else display_all (mean_mean, mean_mad); 

do_3d_all(&memO .bnd, &meml . image 0 , &meml . image 1 , 

memo . imageO , meraO . imagel , memo . image2 ) ; 

return ( SUCCESS ) ; 
) 

display_error(text) char *text; 

i 

gtext_demo ( 3 0 , 100, text, 1, 0, 1); 

) 

- test_for_miss_f eed ( apple_brand , l_image) 
73 PIXEL l_image [ L_FR_Y_SIZE ] [ L_FR_X_SI ZE ] ; 

{ 

int i,j, count; 
#define N_LINES 18 
fl define MIN_T 170 

switch (apple_brand) { 
case SMITHJTYPE: 

SWAP_IN_SIZE( l_image, CAM_2 , w_images ► green , L_FR_ Y_S I Z E * L_FR_X_S I 
break; 
case HERMONJTYPE: 
case ORLEANSJTYPE : 
case ANAJTYPE: 

SWAP_IN_SIZECl_image, CAM_2 , w_images . green , L_FR_Y_SIZE*L_FK_X_SI 
25 ' break; 

) 

for ( count = i =0 ; i < N_LINES ; ++i ) 

for (j = 0 ; j < L FR X_SIZE ; -M-j) 

if ( l_iraage[T] [3] < MIN_T) ++count;' 
if (count > ,50*N_LINES) ( printf ( "\nAbove : %d" , count ) ;p_ermo = 1; return 
count - 0; 

30 for (i = L_FR_Y_SIZE-1 ; i > L_FR_Y_SIZE-N_LINES ; — i) 

for (j = 0 ; j < L FR X_SIZE ; ++j) 

if (l_image[I][5] < MINJT) +-rcount; 
if (count > 60*2*N_LINES) { printf ( "\nBelow: %d", count); p errno =1; ret 
return { SUCCESS ) ; ~ 

) 

di spl a y_a 1 1 ( mean_mean , mean_mad ) 
35 { 

int i; 

for (i = 0 ; i < N_CAMERAS ; ++i ) 
( 

switch(apple_brand) { 
case SMITH_TYPE: 

SWAP_IN_siZE(meml. imagel, i, normal_images . green , FR_Y_SIZE*FR_X_SIZE) 
40 break; 

case HERMON_TYPE: 
case ORLEANS_TYPE : 

SWAP_IN_SIZE(meml . imagel , i , norma l_images . red, FR_Y_SIZE*FR_X_SIZE) ; 
break; 

) 

show_squeesed_image(meml . imagel , "0 M , 
45 atoi ( prog_consts . t_win_X_OFF [ i ] ) , atoi ( prog_cons ts . T_WIN_Y_OFF [ i ] ) ) ; 

J 

) 

display_in_auto_mode(mean_mean, mean_mad) 
{ 

int i; 

i = l; 

50 ( 

s w i t ch ( a pp 1 e_br and ) { 
case SMITHJTYPE: 

SWAP_IN_SIZE(meml . imagel , i, norma l_images .green , FR _Y_SIZE*FR X SIZE) 
break; 
case HERMONJTYPE: 
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case ORLEANSJTYPE: 

SWAP_IN_SIZE(meml . image 1 , 
break ; 



norma l_images . red , FR_Y_SIZE*FR_X_SIZE) ; 



show_squeesed_image( meml . imagel , "0 M , 

a toi ( prog_consts . T_WIN_X_0FF [ i ] ) , atoi ( prog_consts . T_win_Y_OFF [ i ] ) ) ; 
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) 

do_3d_all(bnd0, bndl , bnd2, imageO r imagel, image2) 

PIXEL imageO[FR_Y_SIZE] [FR_X_SIZE] ; 
PIXEL imagel [ FR_Y_SIZE ] [ FR_X_SIZE ] ; 
PIXEL image2[FR_Y_SIZE] [FR_X_SIZE} ; 
struct boundary_data *bnd0; 
struct boundary_data *bndl; 
struct boundarydata *bnd2; 



bnd, 
bnd, 
bnd , 



si zeof (struct boundary_data ) ) ; 
sizeof (struct boundary_data ) ) ; 
si zeof ( struct boundary_data ) ) ; 
enhanced_images .green , FR_Y_SIZE*FR_X_SIZE) 
enhanced_images . green , FR_Y_SIZE*FR_X_SIZE ) 
enhanced_iraages . green , FR_Y_SIZE*FR_X_SIZE) 

imageO, imagel, image2, &apple_volume ) ; 



bnd_z, sizeof (struct boundary_data ) ) ; 
bnd__z , sizeof ( struct boundary_data ) ) ; 
bnd_z , sizeof ( struct boundary_data ) ) ; 



( 

char header [ 64 ) ; 

SWAF_IN_SIZE(bndO, CAM_1 , 
SWAP_IN_SIZE(bndl, CAM_2 , 
SWAP_IN_S I Z E ( bnd 2 , CAM_3 , 
SWAP_IN_SIZE ( imageO , CAM_1 , 
SWAP_IN_SIZE ( imagel , CAM 2 , 
SWAP_IN_SI ZE ( image 2 , CAM_3 , 
#ifdef EYAL_OLDDD 

glob_all(bndO, bndl, bnd2 

#else 

glob allfbndO, bndl, bnd2, &apple volume) 

#endif 

SWAP_OUT_SIZE( bndO , CAM_1 , 
SWAP_OUT_S I Z E ( bnd 1 , CAM_2 , 
SWAP_OUT_SIZE(bnd2, CAM_3 , 

dist = 2.*(pow(applevolume / 3.14 * 3. / 4., 0.33)); 
if <apple_volume <= 120000) dist = dist*1.09; 
else if (apple_volume <= 150000) dist = dist* 1.04; 
else dist - dist* 1.00; 
dist += 3; 

apple_size = (int)(dist +0.5); 

apple_volume=apple_volume*l. 17 + 16470.0; 
printf ( M \n Volume : %4d" , ( int ) (apple_volume / 1000.)); 
print_demo ( 70 , "Volume: " , "%4d","cc", ( int ) ( apple_volume / 1000.)) 
print_demo(70, "Apple width:", «'%4d", "mm" , ( int ) (dist+0 . 5 ) ) ; 
statistics. volume = ( int ) ( apple_volume / 1000.); 
statistics. size = ( int ) (dist+0. 5 ) ; 
return ( SUCCESS ) ; 

} 

print_demo (color, header, form, trailer, 

char *header, *form, *trailer; 
( 

char tmp( 80 ] * 
int i ; 

if (display line_count >= 300+3*20) { 
display_Tine_count « 300; 
display_col_count += 300; 
) 

gtext_demo(display_col_count+30 , display_line_count, header, 1, color, 1); 
sprintf(tmp, form, numl , num2, num3 , num4 ) ; 

gtext_demo(display_col_count+200, display_line_count-5 , tmp, l, color, 2); 
gtext_demo(display_col_count+260, display_line_count , trailer, l, color, 1); 
display_line_count += 20; 



numl, num2, num3 , num4 ) 



) 

load_luts ( ) 

{ 

#define LOAD_LUT ( h , 1 ) if (read_map_f ile(h, 1 ) 



) 



0) { printf ("\n Unable to read 
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#ifdef IP8 

LOAD_LUT( "grab. lut", grab_lut) ; 
LOAD_LUT( "measure . lut" , screen_lut ) ; 
LOAD_LUT ( "blank . lut" , blank_lut ) ; 
#endif 
#ifdef VGA 

LOAD_LUT( "measure. lut" , screen_lut) ; 

#endif 
) 

15 spawn_pass ( args ) 

char *args [ ] ; 

fprintf (stderr, "Not implemented "); 

) 

spawn_pass_l (args ) 

char *args [ } ; 

20 < 

int ret; 
char st[30]; 
int i; 

if (debug_flag) { printf("\n About to run phase: %s\n" ,args[ 0] ) ; 

for (i = 0 ; args[i] != NULL ; ++i) printf ( "%s\t" , args[ i ] ) ; 

} 

25 sprintf (st, "Can' t run %s: n , args[0]); 

#ifndef EY_NNIOS 

finit_display( ); . 
#endif , 

fflush(stdout); ' " : : 

ret = spawnvp(P_WAXT, args[0], args); v 

f flush (stdout) ; 
30 if (ret = -1) { perror(st); } 

#ifndef EY_NNI0S 

init_display( ) ; 

#endif 

return ( ret ) r 

) 

on_indicator(key) char key[] ; 

35 ( 

int f; 

strcpy ( last_key , key ) ; 
for (f = 0 ; f < 8 ; ++f ) 
{ 

if ( buttons [f ] .on_off == 1) release_button(f ) ; 
if ( strcmp (key, buttons [ f ] .act_button) « 0) 
40 press_button ( f ) ; 

} 

) 

of f_indicator(key) char key [] ; 

( 

int f ? 

for (f = 0 ; f < 8 ; ++f ) 
45 ( 

if ( strcmp (key, buttons [ f ] .act_button) == 0) 

release_button( f } ; 

) 

} 

demo_screen ( ) 
( 

50 int x,y,f; 

char t[lO); 
Sifdef IP8 

clear_screen(SCREEN_COLOR) ; 

$endif 

for (f = 0, y - START_Y; y < END_Y ; y += Y_INCREMENT) 
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for (x = START_X ; x < END_X && f < 12 ; x +- X_ INCREMENT ) 
{ 

buttons [ f ] . xs - x ; 

buttons [ f ) . ys = y ; 

buttons [ f ]. xf = x+D_X; 

buttons {f ] .yf = y+D_Y; 

buttons [ f ] . f _color = KEY__COLOH ; 

butt ons[f ] .b_co lor » SHADOW_C0L0R ; 

buttons [ f ] . act_button = k_text [ f ] ; 

buttons [ f ]. text « f_text[f]; 

buttons[f ] .onoff = 1; 

release_button ( f ) ; 

++f ; 

) 

) 

release_button( f ) 
{ 

int xl,yl,x2,y2; 

if ( buttons [ f ] . on_off 

xl — buttons [ f ]. xs ; 

y 1 = buttons [ f ) . ys ; 

X2 = buttons (f ] -xf ; 

y 2 = buttons [ f ] . yf ; 
wifdef IP8 

filled_rec tangle (xl-3,yl-3,x2-3,y2-3 , SCREEN_COLOR ) ? 

f illed_rec tangle ( xl+3 , yl+3 , x2+3 , y2+3 , buttons [ f ] . bgcolor ) ; 

f illed_rectangle(xl ,yl ,x2 ,y2 , buttons [f ] .f_color) ; 

gtext (xl+5,yl-15, buttons [ f ] . act_button ,2,64,1); 

gtext (xl+5+4 5, yl+5, buttons [f ] .text,l, 64 ,1) ; 

Sendif 
Sifdef VGA 

vga_f i lled_rectangle ( xl-SHAD , yl-SHAD ,x2-SHAD , y 2 -SHAD , 7 ) ; 
vga_f i 1 led_rectangle ( x 1+SHAD , y 1+SHAD , X2+SHAD , y 2+SHAD , 0 ) ; 
vga_f illed_rectangle(xl ,yl,x2,y2,buttons[f ] .f_color) ; 
vga_rectangle(xl-l,yl-l,x2,y2,0) ; 

gtextvga ( xl+5 , yl -15 , buttons [ f ] . act_button ,2,64,1); 
gtext_vga ( xl+5+4 5 , yl+5 , buttons [ f ) - text ,1,64,1); 



0) return (0); 



buttons [ f ] . on_of f 
return ( 1 ) ; 



?endif 



) 

press_button( f ) 
( 

int xl,yl,x2,y2; 

if ( buttons [ f ) . on_of f == 1) return(O); 
xl — buttons [ f ] . xs ; 
yl = buttons [f ] . ys; 
x2 = buttons [ f ] .xf ; 
buttons [ f ] . yf ; 



y2 

#ifdef IP8 



£endif 
Sifdef VGA 



f illed_rectangle(xl+SHAD,yl+SHAD,x2+SHAD,y2+SHAD, 7) ; 
f illed_rectangle(xl-3 , yl-SHAD, X2-3 ,y2-SHAD, 0) ; 
f illed_rectangle(xl,yl,x2,y2 , 115) ; 
gtext ( xl+ 5 , yl - 1 5 , buttons [ f ] . act_button ,2,64,1); 
gtext (xl+5+45, yl+5, buttons[f] .text, 1,64,1) ; 



Sendif 



vga_f i 1 led_rectangle { xl+SHAD , y 1+SHAD , X2+SHAD , y 2+SHAD , 
vga_f illed_rectangle ( xl-SHAD , yl-SHAD , x2— SHAD , y 2- SHAD , 
vga_f illed_rec tangle (xl,yl,x 2 ,y2, 115) ; 
vga_rectangle ( xl-1 , yl-1 , x2 , y2 , 0 ) ; 

gtext_vga ( xl+5 , yl-1 5 , buttons [ f ] . actbutton ,2,64,1); 
gtext_vga ( xl+5+4 5 , yl+5 , buttons [ f ] . text ,1,64,1); 



7); 
o); 
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vga rectangle (TEXT_X 1-1, TEXTYl-l, TEXT_X2, TEXT_Y2 # 0); 
10 } 

gtext vga (520, 0, h, 2, 63, 0); 
for (T = 1 ; i < 6 ; ++i ) 

gtext_vga(10+6-i, 0+6-i, "PriOp-l", 4, l29+i*20, 0); 

f- end if 

first_time = 0; 

} 

75 match_apple_brand( name ) char *name; 

{ 

int i; 

for (i = 0 ; apple_brands [ i ] != NULL ; 

if (stricmp(apple_brands[ i] , name) == 0) return(i); 
returnj-1 ) ; 

} 

do_save_data ( image ) PIXEL image [ L_FR_Y_SIZE ] [ L_FR_X_SIZE ) ; 
« 

static unsigned int count = 0? 
FILE *fp; 

char tmpC 64], header [ FR__HEADER_SIZE ] ; 
int cam, x, y, i; 

if (count = 0) { 

fp = fopenf "c:\\apples\\count.dat" , "r")? 
25 if (fp = NULL) count = 0; 

else { f scanf (fp, "%d M ,&count) ; fclose(fp); } 

) 

# define get_and_write(buf , i_name, o_name, cam) SWAP_IN_SIZE(buf , cam, i_name, L_ 
sprintf(tmp, "F:\\apl\\%s. %ld M , o_name, cam); \ 
printf ( "\nSaving %s",tmp);\ 

write_f r_pic ( tmp , buf , L_FR_X_SIZE , L_FR_Y_SIZE , header ) ; 
20 header[0] - 0; 

for (cam = 0 ; cam < N_CAMERAS ; -f-+cara) { 

get_and_write( image, w^images.green, "w_green", cam); 
get_and_write( image , w_images . red , "w_red", cam); 
get_and_write ( image , w_images . ir , "w_ir" , cam) ; 
get_and_write( image, w_images .grid , M w_grid", cam); 

> 

#ifdef OLD 

M sprintf(tmp, »c : \\apples\\G_MTH%2d" , count) ; 

for (i = 0 ; i < strlen(tmp) ; ++i) 

( if (tmp[i] == i • ) tmp[i] = '0'; } 
args[01 = "pkzip.exe"; 
args[l] = tmp; 

args[2] = "w_red.l w_green.l w_ir.l w_grid.l"; 
args(3] = NULL; 
40 spawn_pass_l ( args ) ; 

Ufdef VGA 

sprintf(tmp, "Save Name: %ld", count); 
gtext_vga ( 400 , 30 , tmp , 1 , 63 , 0 ) ; 

#endif 

++count ; 

fp = f open ( "c : \\apples\\count . dat " , V); 
45 f print f ( f p , " %d " , count ) ; 

f close ( f p ) ; 

#endif 
) 

show_sgueesed_image( image , headline, of fx, off_y) char *headline; 
PIXEL image[FR_Y_SIZE] [FR_X_SIZE] ; 

{ 

int i,j; 

for (i = 0 ; i < FR_Y_SIZE ; ++i) 

for (j = 0 ; j < FR_X_SIZE ; ++j) 

image[i][j] = (image[i][j] » l) + 128; 
display_image_demo ( of f _x , of f _y , image , FR_X_SIZE , FR_Y_SIZE , headline ) ; 
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) 



vga_filled_rectangle(off_x+SHAD, of f_y+FR_Y_SIZE, of f _x+SHAD+FR X SIZE, off 
vga_filled_rectangle(of f_x+FR_X_SIZE, off_y+SHAD, off x+SHAD+FR X~SIZE, off 
vga_rectangle(off_x-l, off_y-l, of f_x+FR_X_SIZE, off y+FR Y SIZE,~0); 



display_datum_line_demo(x,y,val , header) char *header; 



, header , val ) ; 
1, 36, 1); 



{ 

char s[ 32 ] ; 

sprintf(s f "%s: %4d' 
gtext__demo ( x , y, s, 

) t 

di sp la y_s ingle object ( image , foreground, background, off x, off y, color) 
PIXEL Troage[FR_Y_SIZE] [FR_X_SIZE] ; ~ 

int i,j; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 

for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 



{ 



#ifdef AAA 



#endif 



) 



if ( image[i][j] == foreground && 

( ( image [i-i] [ j] != foreground } | 

(image[i][ j-l] != foreground ) 

(image [i-1 ] [ j+i] != foreground ) 

( image [ i+l] [ j ] |= foreground ) 

• ( image [ i+1 ][ j+l] ! = foreground ) 

( image [ i+1 ][ j-l] != foreground ) 

( image [ i-l ]( j+i] != foreground ) 

( image [ i-1 ] ( j-l] •= foreground ) ) 

( image [ i-1 ][ j ] = background 
image[i][ j-1] == background 
image [ i-1 ][ j+1] == background 
image [ i+1 ] [ j ] = background | 
image [ i+1 ] [ j+1 ] == background 
image [ i+ 1 ; | [ j - 1 ] -= background 
image [i-1] [ j+1] == background 
image[i-l] [ j-l] *== background ) j 



wpixel_demo( j+off_x, i+off_y, color); 



} 

display_single_ob jectl ( image , foreground , 
PIXEL image [ FR_Y_S I Z E ] [ FR_X_S I Z E ] ; 

int i,j; 

for (i = 1 ; i < FR_Y_SIZE-1 r ++i) 

for (j = 1 ; j < FR_X_SIZE-1 ? ++j) 



background, off_x, off_y, color) 



{ 



if ( image [ i ] [ j ] == foreground && 

( ( image [ i-1 ) [ j ] == background ) 

(image[i][ j-l] == background ) 

( image [ i-1] [ j+1] == background ) 

(image [i+1] [ j] == background ) 

( image [ i+1 H background ) 

(image[i+l] [ j-l] == background ) 

(image[i-l] [ j+l] mm background ) 

( image [ i-1 ][ j-l] == background ) 



)) 



) 



wpixel_demo( j+of f_x, i+off_y, color); 



} 

do_grade_all( ) 
{ 

if ( spots_index-=0 ) 
{ 

if (debug_flag) printf ( "\nERR0R vl : There is not Spots info to grade"); 
return ( 0 ) ; * ' 
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) 

10 do_simple_grade ( f in a l_spots , spots_index , Dark_Red , Simple_red ,Yellow,Green, Or a 

) 

close_stat( ) 
{ 

f close (stat_file) ; 
printf ( "\nStat closed" ) ; 

) 

15 init_statistics( ) 

stat_file = f open ( STAT_FILE_NAME , "a"); 
if (stat_f ile == NULL) ( 

printf ("\nCan't open stat"); exit(l); 

) 

atexit(close_stat) ; 
return ( 1 ) ; 

) 

write_statistics( ) 
{ 

int running_index; 
FILE *fp; 

fp = f open ( "count .dat" , "r" ); 

f scanf ( f p, "%d" , &running_index) ; 
25 fclose(fp); 

fp = fopen( "f :\\apl\\pkcount.dat H , "w" ) ; 

f printf (fp, "%d" , running_index) ; 

f close ( fp) ; 

fp = f open ( "count.dat" , "w" ); 
fprintf (fp, "%d" , running_index+l ) ; 
fclose(fp); 

30 fprintf (stat_f ile, "%3d %3d %3d %3d %3d %3d %3d %3d %3d %3d %3d\n", 

running index, 

statistics . size , 

statistics . volume , 

statistics . color_index_l , 

sta t istics . color_index_2 , 

statistics . color_index_3 , 
35 statistics . color_index_4 , 

statistics. n_rot, 

statistics . n_bruise , 

statistics . n_moth , 

statistics . n_st_ca ) ; 

} 

fill_blem_stat (spots , spt_index, indl , ind2, ind3 ) 
4Q struct spot spots [ ] ; 

int i; 

s tat is tics . n_st_ca = 
statistics . n__rot = 
statistics .n_bruise = 
statistics. n_moth = 0; 
for (i = 0 ; i < spt_index ; ++i) 
{ 

if (f inal_spots[ i] . f lag4 != REAL_BLEMISH) continue; 
switch(f inal_spots[ i] .flag 2) 
( 

case D_ST_CA: ++statistics. n_st_ca; break; 
case D_R0T: 

case D_LROT: ++statistics . n_rot ; break; 
50 case D_BRUISE: ++statistics . n_bruise ; break; 

case D_M0TH: -^statistics .n_moth; break; 

} 

) 
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5 sp_init_xms( ) 

( 

int ret; 

init_xms( ) ; 
init_storage ( 0 ) ; 

ret = dimp_into_file(STORAGE_FILE) ; 
if (ret 1= success) { 
10 printf ( r, \nError in dumping into file " ) ; exit(l) 

) 
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/* 

ID: 001 
File name is: appOl.c 



15 



V 

^include "adapter. h" 
^define I NTERLACE_0 PT IMI Z AT I ON 
extern int debug_flag; 
extern int norm_raw [ N_CAMERAS ] [ 4 ] ; 
extern int p_errno; 
extern struct single_view_inf o view_info[N_CAMERAS] ; 
^define RADIUS 20 
#ifdef INTERLACEJDPTIMIZATION 
^define I_STEP 2 
flelse 

#define i_STEP 1 
20 #endif 

do_measure ( cam , l_image, l_image^l , s_image, s_image_l , bnd, precent, 
— mean_jp, mad_p, min_p, max_p, s_image 2 , apple_brand) 

PIXEL 1_ image { L_FR_Y_SIZE ] [ L_FR_X_SIZE ] ; 
PIXEL l_image_l [ L_FR_Y_S I ZE ] [ LJFR_X_S IZE ] ; 
PIXEL s_image[FR_Y_SIZE] [FR_X_SIZE] ; 
PIXEL s_image_l C FR_Y_SIZE ] [ FR_X_SIZE] ; 
25 PIXEL s_image_2[ FR_Y_SIZE ] [ FR_X_SIZE ] ; 

struct boundary _data *bnd; 
int *raean_p, *mad_p, *min_p, *max_p; 

( 

char s[ 16 ] ; 

int ret, old, precet, u_thresh, l_thresh, xoff , y_off ; 
int il,i2,i3,i4; 
30 °l d = get_channel ( ) ; 

set_channel(cam) ; 

SWAP_IN SIZE( l_image , cam, w_images . green , L_FR_X_SIZE*L_ FR_Y_SIZE) ; 
ret = fTnd_boundary( l_iinage , l_image_l , precent, bnd, 
&u_thresh, &l_thresh, cam) ; 
if (ret 1 = SUCCESS) { p_errno = NOPER; return (ret); ) 
SWAP_IN_SI Z E ( l_image , cam , wimages . green , L_FR_X_S I ZE*L_FR_Y_S I ZE ) ; 
35 ^define GREEN_PIC 0 
^define RED_PIC 1 
^define IR_PIC 2 

Sdefine GRID_PIC 3 

cvt_sml_boundary(bnd , &x_of f , &y_of f ) ; 

SWAP__OUT_S I ZE ( bnd , cam f bnd , s i zeof ( struct boundary_data ) ) ; 
extract__reg_image ( l_image , s_image , x_of f , y_of f ) ; 
„ cancel_wires_n ( s_image , s_image_2 , bnd , cam , GREEN_PIC , x_of f ) ; 

clear_x_sel_color(s_image_2 , bnd->boundary , bnd- > bound a ry_ index, 255); 
SWAP_OUT_SIZE(s_image_2, cam, raw_images . green , FR_X_SIZE*FR_Y_SIZE) ; 
if (apple_brand = SMITH_TYPE) 

2 transf orm( s_image_2 , s_image_2 , mean_p, mad_p, min_j?, max _jp) ; 
else _ 

z_transform_f (s_image_2 , s_image_2 , mean_p, mad__p, min_p, max_p) ; 
SWAP OUT_SIZE(s_image_2, cam, enhanced^images . green , FR_X_SIZE*FR_Y_SIZE) ; 
45 ^define CVT_ALL(src, dstl, dst2 ,pic) SWAP_IN_SIZE( l_image , cam, src , L_FR_X_S 
extract_reg_image ( l_image , s^_image_l f x_of f , y_of f ) ; \ 
cancel_wires_n ( s_image_l , s Tmage_2 , bnd , cam, pic , x_of f ) ; \ 
clear_x_sel_color(s image_2~,~ bnd- > boundary, bnd->boundary_index , 255); \ 
SWAP_OUT_SIZE(s_image_2, cam, dstl, FR_X_SIZE*FR_Y_SIZE) ; \ 
if (apple_brand SMITHJTYPE) \ 

z transform ( s_image_2 , s_image_2 , &il, &i2, &i3, &i4 ) ; \ 
50 else~\ 

z^transf orm_f (s_image_2 , s_image_2 , &il, &i2, &i3, &i4); \ 
SWAP_OUT_SIZE(s_image_2, cam, dst2 , FR_X_SIZE*FR_Y_SIZE) ; 

CVT_ALL(w_images .grid, raw__images .grid , enhanced_images .grid r GRID_PIC)r 
CVT ALL ( w_images . red , raw_images . red , enhanced_images . red , RED_PIC ) ; 
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CVT_ALL (w_i mages . ir, 
set_channel ( old ) ; 
return ( SUCCESS ) ; 



raw_i mages. ir, enhanced_images . ir , IR_PIC); 



) 



normal Jor_shadows ( cam , green, red, ir, grid, bnd ) 
struct boundary_data *bnd; 

unsigned char greenf FR_Y_SIZE] [ FR_X_SIZE ] ; 
unsigned char red[FR_Y_SIZE] [FR_X_SIZE] ; 
unsigned char ir [ FR_Y_SIZE) [FR_X_SIZE ] ; 
unsigned char grid [ FR_Y_S IZE] [ FR_X_SIZE] ; 



{ 



S W AP_I N_S I Z E ( gr e e n 
SWAP_IN_SIZE( red , 
SWAP_IN_SIZE( ir , 
SWAP_IN_S IZE (grid, 
do_nonna 1 ( green , red , i r , 
SWAP_OUT_SIZE(green, cam, 



cam, 
cam, 
cam, 
cam, 



} 



S WAP_OUT_S I ZE ( red , 
S WAP_OUT_S I Z E ( i r , 
SWAP OUT SIZE(grid, 



raw_images .green 
raw_images . red , 
raw_images . ir , 
raw_images . gr id , 
grid, cam); 
normal_images . green , 
cam , norma l_images . red , 
cam, norma l_images . ir , 
cam, no rmal_iraages.gr id, 



FR_X_S IZE*FR_Y_S I Z E ) ; 
FR__X_SIZE*FR_Y_SIZE) ; 
FR_X_S I Z E* FR_Y_S I Z E ) ; 
FR_X_SIZE*FR_Y_SIZE) ; 



FR_X_S I Z E* FR_Y_S I Z E ) ; 
FR_X_S I Z E * FR_Y_S I Z E ) ; 
FR_X_SIZE*FR_Y_SIZE) ; 
FR_X_S I Z E * FR_Y_S IZE) ; 



do_normal ( green , red, ir, grid, cam) 

PIXEL green [FR_Y_SIZE] [FR_X_SIZEJ ; 
PIXEL red[FR_Y_SIZE] [FRXSIZE] ; 
PIXEL ir[FR_Y_SIZE][FR_X_SIZE3 ; 

PIXEL grid[FR_Y_SIZE] [FR_X_SIZE] ; - - • 

{ 

int i, re- 
double g,r,a,f ; 
) 

f ind_boundary( l_image , l_image_l, precent, bnd, u_thresh, l_thresh, cam) 
int *u_thresh, *l_thresh; 

PIXEL l_image[L_FR_Y_SIZE] [ L_FR_X_SIZE] ; 
PIXEL l_image_l[L_FR_Y_SIZ£] [ L_FR_X_SIZE ] ; 
struct boundary_data *bnd; 

{ 

int margins = RADIUS; 
if (debug_flag) 

display_image (0,0, l_image , L_FR_X_SIZE , L_FR_Y_SIZE , "l^image" ) ; 
bnd->boundary_index = locate_boundary ( l_image , l_image_l , margins, precent, 
bnd->boundary , & ( bnd->out_rect ) , 

u_thresh, l_thresh, debug_flag, cam); 
if (bnd->boundary_index = FAILURE) return ( FAILURE ) ; 
if (debug_flag) 

draw_boundary(bnd->boundary, bnd->boundary_index, bnd->out_rect , 300,200, 2 
return ( SUCCESS ) ; 

} 

cancel_wires( l_image, l__image_l, u_thresh, l_thresh, bnd, cam_number) 
PIXEL l_image [ L_FR_Y_S IZE ] [ L_FR_X_SI ZE] ; 
P IXEL l_image_ 1 [ L_FR_Y_S IZE] [ L_FR_X_S IZE] ; 
struct boundary_data *bnd; 

{ 

u_thresh = 160; 

threshold_image_pip( l_image, u_thresh, l_thresh, 1); 
if (debug_flag) 

display_image(0,0 , l_image , L_FR_X_SIZE, L_FR_Y_SIZE, M t_image" ) ; 
cancel_wires_ad( l_image, l_image_l , bnd->out_rect , cam_number ) ,- 
return ( SUCCESS ) ; 

} 

#ifdef AUTO_WIRES 

cancel_wires_auto( t_image , image, bnd, cam_number) 

P IXEL image [ LJR_Y_S IZE ] ( L_FR_X_S IZE ] ; 
PIXEL t_image[L_FR_Y_SIZE] [L_FR_X_SIZE] ; 
struct boundary_data *bnd; 
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int i,j, y, xl, x2, ret, retl , jl f j2, t, tc; 
10 #define DIST 6 

#define MAX_WIRE_WIDTH (WIRE_WIDTH + 4) 
if (debug flag) 

display_image ( 200 , 200 , t_image ,L_FR_X_SIZE, L_FR_Y_SIZE, »w_image« ) ; 
j2 = 0; 
while(l) 



15 



30 



35 



ret = locate vire_adaptive( t_image , bnd, &i, &jl, &j2); 



if (ret != SUCCESS) break; 
t = 160; 

for(tc = 0 ; i >= bnd->out_rect .yl ; — i, ++tc) 
{ for (j = jl ; j <= j2 ; ++j) 

20 5 image [ i] [j] = WIRE MARK; 

if (debug_flag) wplxel( j , i , 255 ) ; 

if (tc >= t) ( tc = 0; jl -= 1; j2 -= 1; ) 

} 

#ifdef DO_INTERPOLATION 

do_interpolation( image, i, jl, j2); 

Sendif 

#undef DIST 

#undef MAX_WIRE_WIDTH 

locate_wire_adaptive(t_image, bnd, ip, jlp, j2p) 
int *ip, *jlp, *j2p; 

PIXEL t_image [ L_FR_Y_SIZE ] [ L_FR_X_SIZE ] ? 
struct boundary_data *bnd; 

{ 

int i, index, il, ], ret; 

for ( i = 0 ; i < bnd->boundary_index ; ++i ) { 

if (bnd->boundary[i] .xl <= bnd->out rect. xl || 

bnd->boundary[ i] .x2 >= bnd->out_rect. x2 ) index - i; 

if (*j2p > 0) j = *j2p; else j = bnd->out_rect. xl ; 
for ( ; j < bnd->out_rect.x2 ; ++ j ) 

for (i = index ; i < bnd->boundary_index ; ++i) ( 

if (bnd->boundary[i] .xl == j | | bnd->boundary[i] .x2 == j) break; 

if (i == bnd->boundary_index) { f printf ( stderr , "HELP" ) ; continue; ) 
40 il - bnd->boundary [ i] .y; 

ret = locate_wire ( t_image , j, j, il+10, jlp, j2p); 
if (ret = SUCCESS) return ( SUCCESS ) ; 

) 

return (FAILURE) ; 

} 

#endif 
45 #define DIST 4 

#define MAX_WIRE_ WIDTH (WIRE_WIDTH + 6) 
locate wire (image, xl, x2 , y, x3p, x4p) 

PIXEL image[L_FR_Y_SIiiE][L^rR_X_SIZE3 ; 

int *x3p, *x4p; 

< 

int kl, k2; 

50 for (kl = xl-DIST ; kl < X2+DIST ; ++kl ) 

{ if (debug_flag) wpixel(kl , y , 0 ) ; 
if (image[y] [kl) == LOW_MARK && image[y ] [ kl-1 ] = HIGH_MARK) 

( for (k2 = kl ; k2 < kl + MAX_WIR£_WIDTH ; ++k2 ) 
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if (image[y][k2] == LOW_MARK && image [ y] [ k2+l ] == HIGH_MARK) 
( 

if (debug_flag) { wpixel ( kl ,y , 55 ) ; wpixel(k2 , y , 55 ) ; ) 

*x3p = kl; 

*x4p - k2; 

return ( SUCCESS ) ; 

) 



*x3p = xl-2; 
*x4p = xl+4; 
return (SUCCESS) ; 

) 

#undef DIST 
#undef MAX_WIRE_WIDTH 

locate_boundary( image, image_l, margins, thresh_precent , 

boundary, out_rect , utp, ltp, debug_flag, cam) 
struct rect *out_rect; 

struct line_j>air boundary [ MAX_BOUNDARY ] ; 
P IXEL image [ L_FR_Y_S I ZE ] [ L_FR_X_S I Z E ] ; 
PIXEL image_l [ L_FR_Y_SIZE ] [ L_FR_X_SIZE ] ; 
int *utp, *ltp; 

{ 

25 int u_thresh, 1 thresh, per; 

struct point points [ RADIUS *' 2 * 4]; 

if (cam — CAM_1 ) u_thresh = 200; 

if (cam == CAM_2) u_thresh = 200; 

if (cam == CAM__3 ) u_thresh = 200; 

1_ thresh =0; 

threshold_image_pip( image, u_thresh, l_thresh, I_STEP); 
2Q if (debug_flag) 

display_image( 200,0, image, L_FR_X_SIZE , L_FR_Y_SIZE, "1" ) ; 
f ilter_with_disc( image, image_l, RADIUS, points); 
if (debug_flag) { 

printf("\n Thresh: %d %d", ujthresh, l_thresh); 
display_image(400,0,image_l,L_FR_X__SIZE,L_FR_Y_SIZE, "2") ; 

> 

per = encirc outer_gradient ( image_l , out_rect, 
35 L_FR_X_SIZE, L_FR_Y_SIZE, RADIUS, boundary); 

*utp = u_thresh; 
*ltp = l_thresh; 
if (per < 20) return ( FAILURE ) ; 
return ( per ) ; 

} 

f ilter_with_disc(src, dst, radius, points) 
4Q struct point points []; 

P IXEL s rc [ L_FR_Y_SI Z E ] [ L_FR_X_S I Z E ] ; 
PIXEL dst[L_FR_Y_SIZE] [ L_FR_X_SIZE ] ; 

( 

int circle_JLen , i , j ; 

circle_len = circle_points( 0 , 0, 6, 200, points); 
open_image_circle_p(src , dst, points, circle_len, radius); 
if (debug_flag ==2) 
45 display_image(0,0, dst, 192,192,"*")? 

circle_len = circle_points (0, 0, radius, 200, points); 
open_image_circle_p(dst , src, points, circle_len, radius); 
for (i = 0 ; i < L_FR_Y_SIZE ; ++i) 

for (j - 0 ; j < L FR X_S1ZE ; ++j) 

dst[i][j] = srcrTHl]; 

) 

50 #ifdef NOT_IN_USE 

open_image_circle(src, dst, points, len, radius) 
struct point points [ ] ; 

PIXEL src[L FR Y SIZE][L FR X SIZE); 
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PIXEL dst[L_FR_Y_SIZE] [L_FR_X_SIZE J ; 

{ 

int i,j,k, dy, dx, flag, w; 

for (i = 0 ; i < L_FR_Y_SIZE ; 
for (j = 0 ; j < L_FR_X_SIZE 
dst[ij[j] = HIGH_MARK; 
for (i = radius ; i < L_FR_Y_SIZE - radius ; i+= l) 

for ( j = radius ; j < L_FR_X_SIZE - radius ; j += 



1) 



{ 

#define STEP 1 



if (src[i][j] != LOW_MARX) continued- 
flag = l; 

for (k = 0 ; k < len ; k += (8*STEP)) 



{ 



dy = i+points[k+2] .y; 

for (w = j+points[k+2] .x ; w < j+points[k+0 ) .x ; w STEP) 

if (src[dy]{w] != LOW_MARK) {flag = 0 ; goto next; } 
dy = i+pointsf k+3 ] .y : 

for (w = j-»-points[k+3] .x ; w < j+points[k+l] .x ; w += STEP) 

if (src[dy][w] != LOWMARK) {flag = 0 ; goto next; ) 
dy = i+points[k+7] .y; 

for (w = j+points[k+7] .x ? w < j+points[k+5 ] .x ; w += STEP) 

if (src[dy][w] 1= LOW_MARK) {flag « 0 ; goto next; ) 
dy = i+points[k+4] .y; 

for (w = j+points[k+6] .x ; w < j+points[k+4 ] . x ; w += STEP) 

if (src[dy][w] != LOW_MARK) {flag = 0 ; goto next; ) 



30 



35 



#undef STEP 
next: 



if (flag) { 

for (k = 0 ; k < len ; k += 
{ 

dx = points [k ] .x; 
dy = points [k] .y; 
dx = j + dx ; 
dy = i + dy ; 
dst[dy][dx] = LOW_MARK; 
if (debug^flag == 2) 

wpXxel ( dx , dy , 19 ) ; 

) 



1) 
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} 

} 

#endif 

open_image_circle_p(src , dst, points, len, radius) 
struct point points [ j ; 

PIXEL src [ L_FR_Y_SIZE ) [ L_FR_X_SIZE ] ; 
PIXEL dst[L_FR_Y_SIZE] [L_FR_X_SIZE] ; 

{ 

int i,j,k, dy, dx, flag, w; 

for (i = 0 ; i < L_FR_Y_SIZE ; ++i ) 

for (j = 0 ; j < L_FR_X_SIZE ; ++j) 
dst[i][j] = high_mark; 
for (i = radius ; i < L_FR_Y_SIZE - radius ; i += I_STEP) 

{ 

for (j = radius ; j < L_FR_X_SIZE - radius ; j += 1) 



{ 

^define STEP 1 



if (src[i]Cj] != LOWJMARK) continue; 
flag = 1? 

for (k = 0 ; k < len ; k += 1 ) 
{ 
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dy = points [k] .y; 
#ifdef I NTERLAC E_OPTI M 1 2 AT ION 

if (dy & 1) continue; 

#endif 

dx = points [k] .x; 
dx » j + dx; 
dy = i + dy; 

15 if (src[dy][dx] ! = LOW_MARK) (flag * 0 ; goto next; } 

J 

lundef STEP 
next: 

if (flag) { 

for (k = 0 ; k < len ; k += 1 ) 

{ 

dy - points [k] .y; 
#ifdef INTERLACE_OPTIMIZATION 

if (dy & 1) continue; 

*endif 
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dx = points [k] . x; 
dx = j + dx ; 
dy = i + dy ; 
dst[dy][dxj - LOW_MARK; 
25 if (debug flag = 2) 

wpTxel ( dx , dy , 19 ) ; , 
) , . • 

) 

} * 

) 

encirc outer_gradient ( image , enclosing, x_dim, y_dim, margin, boundary) 
30 struct linepair boundary [MAX_BOUNDARY] ; 

PIXEL image { L_FR_Y_s i ZE ]( L_FR_X_SI ZE ] ; 
struct rect *enclosing; 

int i, jl, j2, flag, area = 0, s_i , len, d, tr, trl, pix, pixO; 
int min_i, max_i, min_j = 999, max_j = -1; 

int pixl, pix2, pix3 , grad , gradO , pi , p2, boundary_index; 
tr = 0; 
trl = 0; 
len = 255; 
boundary_index = 0; 

for ( s_i = 0 , i = margin ; i < y_dim-margin ; i += I_STEP ) 
{ 

flag = 0; 

for (jl = margin ; jl < x_dim-margin ; jl +*» 1) 

40 ( 

^define MIN_GRAD 40 
3 define ENV 1 

pix - image[ i ] [ jl ] ; 
pixl=» image [ i-ENV] [ jl] ; 
pix2= imagef i] E jl+ENV] ; 
pix3= iraage[i+ENV] [ jl) ; 
grad = MAX ( (pixl-pix) , (pix-pix2)); 
45 grad = MAX(grad, (pix3-pix)); 

if (grad > MIN_GRAD ) { flag = 1 ; 
if (grad == (pix-pix2)) jl += ENV; 

flifdef DEBUG 

wpixel( jl, i ,grad) ; printf("\n %d %d %d" , jl, i ,grad) ; 

Sendif 

break ; } 

} 

if (If lag && boundary_index > 1) { 

if (debug_f lag) printf("\n break"); break; } 
if (Iflag) continue; 
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flag = 0; 

10 for (j2 - x_dim-margin ; j2 >= jl ; — j2) 

( 

pix = image [ i ] [ j2] ; 
pixl = image [ i-ENV] [ j2] ; 
pix2 - image [ i] [ j2-ENV] ; 
pix3 = image [ i+ENV] [j2] ; 
grad = MAX( ( pixl-pix ) , (pix-pix2)); 
grad = MAX(grad, (pix3-pix)); 
if (grad > MIN__GRAD) ( 
flag = l ; 

if (grad == (pix-pix2)) j2 -= (ENV-1); 

fcifdef DEBUG 

wpixel( j2,i,grad); printf("\n Id %d %d» , j2 , i ,grad ) ; 

#endif 

break ; } 

} 

if (If lag && s_i) { if (debug_f lag ) printf(*'\n Error #1!"); 

if ( bounda ry_index > 40) break; 

else exit( 0 ) ; } 
if (Jflag) continue; 
-i-+s_i ; 

if (debug_flag && 0) { wpixel ( jl , i , 255 ) ; wpixel( j2 , i , 254 ) ; ) 
25 if (boundary_index > 0) { d = len - (j2-jl); if (d < 0) d = -d; 

if (d > 60) 

if ( boundary index > 10 ) { if (debug_f lag) printf( M \n dist: %d", d) 
else { boundaryindex - 0; continue; ) 
len - j2-jl; 

> 

else len - j2-jl; 
30 boundary [ bounda ry_i ndex] .y = i; 

boundary [bounda ry_JL ndex] . xl = jl; 

boundary [ boundary i ndex j.x2 = j 2 ; 

++boundary_index ; 
#ifdef INTERLACE_OPTIMIZATION 

boundary[ bounda ry_index] .y = i+1; 

boundary [ bo undary_i ndex ] .xl «= jl; 
35 bounda ry [ bo undary_i ndex] .x2 = j2; 

++boundary_index ; 

#endif 

if ( boundaryindex >= MAX_BOUNDARY ) { printf("\n Boundary too long"); 

exit(O); ] 

area += (j2-jl+l); 
max_i = i; 

if (jl < min_ j ) minj - jl; 
if (j2 > max_ j ) max_j = j2; 

I 

min_i = max_i - I_STEP*s_i; 
enclosing -> xl = min_j; 
enclosing -> x2 = max_j; 
enclosing -> yl = min_i; 
enclosing -> y2 = max_i; 
*° if (debug_flag) 

printf("\n %d %d %d %d %d",min_j, max_ j , min_i, max_i, bounda ry_index) ; 
return ( bounda ry_index ) ; 
?undef ENV 
) 

fifdef NOT_USED 

choose_threshold_level_l( image , mar, thresh_precent ) 
50 ~ PIXEL image[L_FR_Y_SIZE] [L_FR_X_SIZE3 ; 

{ 

double sum; 
int i, j; 

unsigned int n, nl, thresh, count; 
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n = 0; 
sum = 0; 

10 for (i = mar ; i < L_FR_Y_SIZE-mar ; i += 2 ) 

for (j = mar ; j < L_FR_x_SIZE-mar ; ++j) 

* if (image[i][j] > 253) continue; 

sum +« (double ) imagef i] [ j] ; -M-n; 

) 

sum = sum / (double )n; 

1j n h = e ?intH( double )n * (double ) thresh_precent / 100. + 0.5); 

count = 0 ; 
do < 

thresh +- ((int)sum * 0.1); 
++count ; 
*nl = 0; 

for (i = mar ; i < L_FR_Y_SIZE-mar ; ++1 ) 
for (j = mar ; j < L_FR_X_SIZE-mar ; ++ j ) 

{ if <image[i][j] > 253 || image[i][j] < 10) continue; 
if (image[i][j] < thresh) ++nl; 

) while (nl < n && thresh < 255);. ' . 
25 if (thresh > 253) { printf("\n Thresh set to default"); return(250); ) 

return ( thresh ) ; 

#endif 

choose threshold level_u( image , mar, thr esh_precent ) 
PIXEL iroage[L_FRJf_SIZE][L_FR_X_SIZEj; 

( 

double sum; 
int i,j; 

unsigned int n, nl, thresh, count; 
# define DEF_TR 240 
n = 0; 
sum = 0; 

for (i = mar ; i < L_FR_Y_SIZE-mar ; i += I_STEP) 
for ( j = mar ; j < L_FR_X_SIZE-mar ; ++ j ) 

if (image[i}[j] > 253 |j image[i][j] < 10) continue; 
sum += (double) image [ ij [ j ] ; ++n; 

) 

sum = sum / (double )n; 
thresh = ( ( int ) sum * 0.8); 

n = (int) ( (double )n * (double ) thr esh_precent / 100. + 0.5); 
40 count = 0; 

do ( 

thresh += ((int) sum * 0.05); 
++count ; 
nl = 0; 

for (i = mar ; i < L_FR_ Y_S I Z E - ma r ; i += I_STEP) 
for (j = mar ; j < L_FR_X_SIZE-mar ; ++ j ) 
45 { 

if (image[i][j] > 253 |j image[ i ] [ j ] < 10) continue; 

if (iraage[i! [ j] < thresh) ++nl; 

) 

} while (nl < n && thresh < 255); 
if (thresh > DEF_TR) { printf("\n Thresh set to default"); return ( DEF__TR ) 
return (thresh) ; 

50 ) 

threshold image pip (image, u_thresh , l_thresh , i_step) 
~ PIXEL image [ LJFR_Y_SIZE J [ L_FR_X_SIZE] ; 

< 

int i,j; 
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for (i = 0 ; i < L_FR_Y_SIZE ; i += i_step) 
for (j = 0 ; j < LFRXSIZE ; 

if (image(i][ j] < u_thresh && image ( i ][ j ] >= l_thresh) 

image[i] [ j) = LOW_MARK ; 
else if (image(i][ j] < 255) image[i][j] = HIGH__MARK ; 

) 

int circle_length; 
static 

Wput_dot ( x , y , color , circle_points ) 

struct point circle_points[ ] ; 

{ 

circle_points[circle_length] .x = xr 
circle_points[circle_length] .y = y; 
++circle_length ; 

) 

static 

Wcircle_dot ( x , y , c_x , c_y , color , circle_points ) 
struct point circle_points[ ] ; 
int x,y,c_x,c_y; 

{ 

Wput_dot{ x+c_x , y+c_y , color , circle_points ) ; 
Wput_dot( y+c_x ,x+c_y , color , circle_points ) r 
Wput_dot ( -x+c_x , y+c_y , color , circle_points ) ; 
25 Wput_dot ( -y+c_x , x+c_y , color , circle_points ) ; 

Wput_dot ( x+c_x , -y+c_y , color , circle jpoints ) ; 
Wput_dot( y+c_x , -x+c_y, color , circle_points ) ; 
Wput_dot ( -x+c_x , -y+c_y , color , circle_points ) ; 

Wput_dot(-y+c_x,-x+c_y , color, circle_points ) . ,* • 
return ( 1 ) ; 

> 

30 ^define COS45 .707 

circle_points ( c_x , c_y , r , color , circle_points ) 
struct point circle_points[ ] ; 
int c_x,c_y,r; 

{ 

int x , y = r , 

di = 3-2*r ? 
int lim_x - (int)(COS45 * ( float )r +0.5); 
circle_length = 0; 
for (x = o ; x <= lim_x ; ++x) 
( 

if (di > 0) 
{ 

di += 4*(x-y)+6; 

Wcircle__dot(x, — y , c_x , c_y , color , circle_points ) ; 

) 

else 
( 

di += 4*x+2; 

Wcircle_dot(x,y ,c_x, c_y, color ,circle_points ) ; 
) 

45 return ( circ le_length ) ; 

J 

struct point w_adhok[ ] = { 44, WIRE_MARK , 61 , WIRE_MARK, 0, 0, 

146, WIRE_MARK , 0, 0, 0, 0, 

55, WIRE_MARK , 112, WIRE_MARK, 150, WIRE_MARK }; 
cancel_wires_ad( t image, image, out_rect, canwiumber) 
PIXEL Imag e [ L FR Y S I Z E ] [ L_FR_X_S I ZE ] ; 
50 PIXEL t_image [ L_FR_Y_SI ZE ] [ L_FR_X_SI ZE ] ; 

struct rect out_rect; 

( 

int i ; 

for (i = cam_number*3 ; i < (cam_number+l)*3 ; ++i) 
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10 ( 

if ( w_adhok [ i ] . x = O) continue; 

cancel_wires_adhok(t_image , image, out^rect . y2+4 , 

w_adhok [ i ] . x , cam_number , w_adhok [ i ) - y ) ; 

) 

cancel wires adhok(t image, image, io , jo, cam, mark_color ) 
PIXEL Tmage [ L_FR_Y_SIZE ] [ L_FR_X_S I ZE ] ; 
15 PIXEL t_image [ L_FR_Y_SIZE ] [ L_FR_X_SIZE ] ; 

int i,j, yl, y2 , xl, x2, x3 , x4 , x5, x6, ret, retl , jl, j2, t, tc, delta; 
#define DIST 4 

^define MAX_WIRE_WIDTH (WIRE_WIDTH + 4) 
if (io & 1) ++i0; 

ret = locate_wire( t_image, j0-4, jO+4 , io, &x3 , &x4 ) ; 
20 if (ret == SUCCESS) { 

x5 = x3 ; x6 = x4 ; 

jl = MIN(x3,x5) ; 
j2 = MAX(x4,x6)+l; 
if (cam -= CAM_1) t = 80; 
if (cam == CAM_2) t = 200; 
if (cam == CAM_3) t = 200; 
delta = — 1; 
if (jl <= (L_FR_X_SIZE / 2)) ( j2 += 1; } 
else { j2 -= 1; } 

for(tc - 0, i = L_FR_Y_SIZE-1 ; i > O ; — i, ++tc) 
{ 

for ( j = jl ; j < j2 && j < LJFR_X_SIZE; 

i 

iroage[i](j] = mark color; 
30 if (debug_flag) wplxel( j , i , 255 ) ; 

if (tc >= t) ( 



25 



} 



) 

) 



tc = 0; jl -= delta; j2 -= delta; 
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} 

cvt_sml_boundary ( bnd , x_of f , y_of f ) 
struct boundary _data *bnd; 
int *x_off, *y_off; 
{ 

int sum_x, sum_y, i; 
sum_x = sum_y = 0 - ; 

for (i = 0 ; i < bnd->boundary_index ; ++i) 

sum__x += (bnd->boundary[i] .xl + bnd->boundary[ i ] .x2 ) ; 
40 *y_off = (bnd-> boundary [0] .y + bnd->boundary[bnd->boundary_index-l ] . y ) >> 1; 

*x_off = (int)(sum_x / (double) (i+i ) +0.5); 
*x_off -= ((FR_X_SIZE) >> 1); 
*y_off — ((FR_Y_SIZE) >> 1); 

modify_bnd(bnd->boundary , &(bnd->out_rect) , bnd->boundary_index, *x_off, *y_of 

) 

modi fy_bnd( boundary , outrect, boundary_index , off_x, off_y) 
struct line__pair boundary [ ] ; 
struct rect *out_rect; 

{ 

int i; 

for ( i = 0 ; i < boundary_index ; ++i ) 
( 

boundary[i] .y -= off_y; 
boundary [ i] .xl — off_x; 
50 boundary [ i] .x2 -= off_x; 

) 

out_rect -> xl -= of fx; 
out rect -> x2 -= off x; 
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outrect -> yl -= off_y; 
out^rect ->.y2 -= off_y; 

extract reg image (image, irnagereg, x of f , y_off) 
10 ~ unsigned char image [L_FR_Y_SIZE] ( L_FR_X_SIZE J ; 

unsigned char image_reg [ FR_Y_SIZE ] [ FR_X_SIZE ] ; 

{ 

int i,j; 

for (i - 0 ; i < FR_Y_SIZE ; ++i) 
for (j = 0 ; j < FR_X SIZE ; ++j) 

image_reg [ i ] [ j ] = Image [ i+y_off )[ j+x_off ] ; 

15 } 

copy_wi re_ma rk ( image , mask) 

unsigned char image [ FR_Y_SIZE] [FR_X_SIZE] ; 
unsigned char mask[FR_Y_SIZE] [FR_X_SIZE] ; 

{ 

int i,j; 

for (i = 0 ; i < FR_Y_SIZE ; ++i ) 

for (j = 0 ; j < FR_X_SIZE ; ++j) 
20 if (mask[i][33 == WIRE_MARK) image[i][j] = wire_mark 

else if (mask[i]tj] = 255) image[i][j] - 255; 

) 
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/* 

10 ID: 009 

File name is: app06.c 



*/ 

a include "adapter. h M 
# include <limits.h> 
^include <stdio.h> 
15 #define STEM 

extern struct prog_settings prog_consts ; 

extern int debug_flag; 

extern int norro_raw [ N_CAMERAS ] [ 4 ] ; 

make_rouler_p( xs , ys , xend , yend , step , grade, header, cl,c2) char *header; 
( 

20 global_color_analysis(cam_num, bnd, green_image , red_image ,grid_image , color_mask, 
~ Dark_Red,Simple_Red, Yellow, Green, Orange, Sat , Changes, no 

int cam_nuni , apple_brand , no_color ; 

long *Dark_Red, *Simple_Red, * Yellow , *Green , *Orange , *Sat , ^Changes,* 

PIXEL red_image[FR_Y_SIZE] [FR_X_SIZE] ; 

PIXEL green image [ FR_Y_SIZE] [ FR_X_SIZE] ; 

PIXEL grid_Image [ FR_Y_S IZE ] [ FR_X_SI ZE ] ; 

PIXEL co 1 o r_ma sk [ FR_Y_S IZE] [ FR_X_S IZE); 

struct boundary_data *bnd; 

{ 

int i , j , max_^y , r ? 

PIXEL Level_thresh; . • 

float R_Gd,GJ3d,RTL,RTM,RTH,GTL,GTM,GTH, satu=0.; 
^define SAMPLE_STEP_SIZE 2 
switch ( apple_brand ) { 
30 case SMITH_TYPE : 

{ 

Level_thresh=SMITH_GRID_THRESH ; 
RTL=SMITH_RED_THRESH_LOW ; 
RTM=SMITH_RED_THRESH_MEDIUM ; 
RTH=SMITH_RED_TKRE5H_HI GH ; 
GTL=SMITH_GREEN_THRESH_LOW ; 
35 GTM=SMITH GREEN__THRESH_MEDIUM ; 

GTH=SMITH_GREEN_THRESH_HIGH; 

break; 

J 

case HERMONJTYPE: 
case ANA_TYPE: 
case 0RLEANS_TYPE : 

40 Level_thresh=ORLEANS J3RIDJTHRESH ; 

RTL=ORLEANS_RED_THRESH_LOW 7 

RTM=ORLEANS_RED_THRESH_MEDIUM ; 

RTH=ORLEANSJRED_THRESH_HIGH ; 

GTL— ORLEANS_GREEN_THRESH_LOW ; 

GTM=ORLEANS_GREEN_THRESH_MEDIUM ; 

GTH=ORLEANS_GREEN_THRESH_HIGH ; 
45 break? 

) 

) 

for (i=0 ; i < FR_Y_SIZE ;i++) 

for (j=0 ; j < FR_X_SIZE color_mask[ i ] [ j )=0 ; 

max_y=bnd-> boundary [ bnd->boundary_index-l ] . y-r ; 
-a for (i=bnd->boundary[r) .y ; i < max_y ; i +=S AMPLE STEP_S IZE) 

I 

for ( j=bnd->boundary[r ] .xl+2 ;j <= bnd->boundary [ r ] . x2-2 ; j+=SAMPLE_STEP 
{ 

if ( grid_image [ i K j ] > Levelthresh) 
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10 ( . . .... 

R_Gd=red_image[i] [ j ]/( float ) grid unage[i] [ 3] ; 
G_Gd=green_image [ i ] [ j ]/( float ) grTd_image [ i ] [ j ] ; 
if (R_Gd <= RTL && G_Gd <= GTL) 
{ 

colorjnask [ i ] C j ] =DARK_RED_COLOR ; 
(*Dark_Red)++; 

if ( R_Gd < 0.7) satu+=(0.7-R_Gd) ; 
} 

else if (R_Gd <- RTH && G_Gd > GTH) 
{ 

color_mask [ i ] [ j J=GREEN_C0L0R ; 
(*Green)++; 
) 

else if (R_Gd > RTH && G_Gd > GTH) 
{ 

color ciask [ i ] [ j ] =YELLOW_COLOR; 

<*Yellow)++; 

) 

else if (R_Gd > RTM && G_Gd > GTM && G_Gd <= GTH) 
{ 

Color_Jnask[ i ] [ j )=ORANGE_COLOR; 
25 (*Orange)++; 

) 

else 
( 

co 1 or _ma sk [ i ) [ j ] =S IMPL E_RED_COL0R ; 
(*Simple_Red)++; 

if (color_mask[i-SAMPLE_STEP_SI2E] [ j] 1= SIMPLE_RED_COLOR ) 
SO (*Changes)++; 

it" (color_mask[i] [ j-SAMPLE_STEP_SIZE] 1= S IMPLE_RED_COLOR ) 

(* change s)++; 
if ( R_Gd < 0.7) satu+=(0.7-R_Gd) ; 
J 

} 

else (*no_color)++; 

35 ) 

r+=S AMPLE_STEP_S I ZE ; 

) 

satu/=(f loat) ( (*Simple_Red) + ( *Dark_Red) ) ; 
satu-=0 . 2 ; 

if (satu <= 0.) satu= 0.01; 
satu/=0. 07; 

(*Sat)+= (long) ( satu*33. +0.5); 

40 v 
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/* 

ID: 002 

10 File Name is: app0 2.c 

*/ 

# include "adapter. h" 
# include <math.h> 
#include <stdio.h> 
^define CALYX_GAP 5 
#define MAX__RECURSE 604 
15 PIXEL grid[FR_Y_SIZE][FR_X_SI2E]; 

PIXEL green [ FR_Y_SIZE ] [ FR_X_SIZE ] ; 
PIXEL red[ FR_Y_SIZE] [FR_X_SIZE] ; 
PIXEL aa [ FR_Y_S I ZE ] [ FR_X_S I ZE ] ; 
PIXEL res [ FR_Y_SIZE J ( FR_X_SIZE ] ; 
char header [ FR_HEADER_S I ZE ] ; 

static struct line_pair boundary [ MAX_BOUNDARY ] ; 
20 static int boundary_index ; 

static struct rect out_rect; 
static int debug_flag; 
static int rec_depth; 

cance l_touch_f rame ( mat , boundary , boundary_index ) 
PIXEL mat[ ] [FR^X_SIZE] ; 
struct line_paTr boundary []; 

25 { 

int i, il, j2, jl, 1, count; 

for (i « 0 ; i < boundary_index ; ++i) _ 

< . - 

il = boundary [ i ]. y? ~ 

jl = boundary[i] .xl? * * ' ■ ■ % - ■. ■ > 1 

j2 = boundary [ i] ,x2; 
30 if (mat[il] [ jl+1] > 0) { rec_depth = 0; cancel_grow(il, jl+1); } 

if (mat[ il] [ j2-l] > 0) { rec_depth = 0 cancel_grow< il , j2-l); ) 
for (1 = jl ; 1 < j2 ; ++1) 

if (res[il][lj = 99 && aa[il][l] > 0) 

{ rec_depth = 0 ; cance l_g row( il , 1 ) ; } 

} 

for ( count = i = 0 ; i < bound ary_ index ; ++i ) 
35 ( 

il = boundary [ i ]. y ; 
jl = boundary[i] .xl; 
j2 = boundary [i] .x2 ; 

for (1 = jl ; 1 < j2 ; ++1) if (aa[il][l] > 0) ++count; 

) 

return ( count ) ; 

) 

cancel_grow( iO , jo ) 

{ if (iO < 0 | | jO < 0 | | iO >= FR_Y_SIZE | | jO >= FR_X_SIZE) return(l) 

if (aa[iO][ jO] > 0) { 

if (rec_depth > MAX_RECURSE) { return(O); } 

++rec_depth; 
45 aa[i0] [ jO] = 0; 

cancel_grow( iO-l , jO ) ; 

cancel_grow( i0+l , jO); 

cancel__grow(io, jo+i); 

cancel_grow( iO , j0-l); 

cancel_grow(i0-l , j0-l); 

cancel_grow( iO-l , jO+1); 
50 cancel_grow( iO+1 , jO-1); 

cancel_grow( io+l , jO+1); 

— rec_depth; 

} 

) 

f inal_decision(res, green , red, aa, boundary, boundary_index,out_mask) 
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PIXEL res [ ] [ FR_X_SI ZE ] ; 
PIXEL green [ ] [ FR_X_SI2E ] ; 
PIXEL red [ ] [ FR_X_SIZE ] ; 
PIXEL aa[ ] [ FR_X_SIZE] ; 

PIXEL out_mask[FR_Y_SIZE] [FRXSIZE] ; 
struct linepair boundaryf]; 

{ 

int i,y,xl,x2,j; 
15 clear_mat ( out_mask ) ; 

for (i = 0 ; i < boundary_index ; ++i) 
( 

y = boundaryf i] .y? 
xl = boundary [i ] .xi ; 
x2 - boundary fi ] .x2; 

for (j = xl ; j < X2 ; 

20 1 

if (res[y][j] — 253) (rec_depth = 0 ; grow(y f j); 

> 

} 

} 

dialate(mat, matl) 

PIXEL mat[ ] [FR_X_SIZE] ; 
PIXEL matlf ] fFR_X_SIZE] ; 

{ 

int i , j , count = 0 ; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 

for (j = 1 ; j < FR_X SIZE-1 ; ++j) 

if (matfi-1] fl] == 200 II mat[i][j-l] == 200 j| 
raat[i-H] [ j] == 200 || mat[i][j+l] = 200) 
{ matl[i][j] = 200; ++count; } 
30 else raatl[i][j] = mat[i][j]; 

return ( count ) ; 

) 

clear_inat(iu) long *ra; 
( 

long *p; 

p = FR_X_SIZE / sizeof(long) * FR_Y_SIZE + m; 
55 for ( ; ro < p ; ++m) *m = 0; 

} 

d00(grid, boundary, boundary_index, out_rect, res) 
PIXEL grid[FR_Y_SIZE] f FR_X_SIZE] ; 
PIXEL res [FR Y_SIZE] [ FR_X_SIZE] ; 
struct line__paXr boundaryf]' 
struct rect out_rect ; 
int boundary index; 

40 , 

int i,j, xl, v_index; 

unsigned char vec[FR_X_SIZE] , markf FR_X_SIZE] ; 
for (i = 0 ; i < boundary_index; ++i) 
< 

xl = boundaryf i ] .xl + 2; 
v_index = horizontal_walk(grid , i, vec, boundary, xl); 
45 anal_vec(vec , v_index, boundaryf i ] .y, xl, res, mark); 

} 

) 

horizontal_walk(grid , i, vec, boundary, x2) 
PIXEL grid[FR_Y_SIZE] [FR_X_SIZE] ; 
struct line_pair boundaryf ] ; 
unsigned char vecf]; 

{ 

int y,j,l, xl, v_index, min_p, max_p; 
y =' boundary f i 3 . y ; 
if (debug_flag) wpixel(x2, y, 255); 

v index =0; 
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for (j = x2+l , 1 = y; grid[l]£j] ; ++j) 
{ 

if (debug_flag == 2) wpixel ( j , 1 , 254 ) ; 
vec[v_index] = grid[l][j]; 
++v_index ; 

} 

return ( v_index ) ; 

) 

#ifdef GRID_HORIZONTAL 

d90(grid, boundary, boundary_index , out_rect, res) 
PIXEL gr id C FR_Y_S I Z E ] [ FR_X_S IZE] ; 
PIXEL res [FR^Y_SIZE] [FR_X_SIZE] ; 
struct line_pair boundary [ ] ; 
struct rect out_rect; 
int boundary_index; 

{ 

int i,j, xl , v_index, x2; 
unsigned char vec[128], inin_p, max_p; 

for (i = 0 ; i < boundary_index ; ++i) 
( 

xl = boundary [i] .xl; 
if (xl <= out_rect .xl+2) 
break; 

) 

if (i — boundary_index ) { printf("\n Warning: Unable to find place in Lt. c 

" ) . 

for ( ; i > 0 ; — i) 

{ • ' 

for (x2 = boundary [ i ]. xl ; x2 < boundary [ i-1 ] .xl ; ++x2) 

{ 

v_index = vertical_walk(grid , i, vec, boundary, &min_p, &max_p, x2); 
analvecf vec , v_index , min_p, raax_p, boundary[ i ] . y , x2, res); 

) 

) 

for (x2 = boundaryf 0 J .xl ; x2 < boundary [ 0 ] .x2 ; ++x2) 
{ 

v_index = vertical_walk(grid , 0, vec, boundary, Smin__p, &max_p, x2 ) ; 
anal_vec( vec , v_index, min_p, max_p , boundary [ i ]. y , x2, res); 

} 

for (i - l ; i < boundary_index ; ++i) 
< 

for (x2 = boundary [ i-1 1 .x2 ; x2 < boundary [ i T ,x2 ; ++x2) 
{ 

v_index = vertical_walk(grid , i, vec, boundary, &min_p, &max_p, x2); 
anal_vec(vec, v_index, min_p, max_p, boundary [ i ] . y , x2, res); 

} 
J 

) 

vertical_walk(grid , i, vec, boundary, min_pp, max_pp, x2) 
PIXEL grid[FR_Y_SIZE][FR_X_SIZE] ; 
struct line_pair boundary[ ] ; 
^_ unsigned char vec[]; 

int *min_pp, *max_pp; 

t 

int y, j , 1 , xl , v_index , min_p , max_p; 
y = boundary [i] .y ; 
if (debug_flag) wpixel(x2, y, 255); 

v index = 0 ; 
min_p = 255; raax_p = 0; 

for (j = x2 , 1 = y+1 ; grid[l][j] : ++1 ) 
{ 

if (debug_flag == 2) wpixel ( j , 1 , 254 ) ; 
vec[v__index] = grid[l][j]; 

if ( vec [ v_index ] > max_p ) max_p = vec [ v_index ] ; 
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else if ( vec[v_index J < min_p) min_p = vec[v_index] ; 
10 ++v_index; 
) 

*min_pp = min_p; 
*max_pp = iuax_p; 
return (v_index) ; 

) 

#endif 
15 jfifdef GRID_45 

d45(grid, boundary, boundary_index , out_rect, res) 

PIXEL grid[FR_Y_SIZE] [FR_X_SIZE] ; 

PIXEL res[FR Y_SI2E] [ FR__X_SI2E) ; 

struct line_palr boundary £) '> 

struct rect out_rect; 

int boundary_index; 

{ 

int xl, v_index, x2 ; 

unsigned char vec[128], min_p, max_p; 

for (i = 0 ; i < boundary_ index; ++i) 
( 

xl = boundary [ i ] .xl ; 
if (xl <= out_rect.xl+2) 
break ; 

> • 
if <i == boundary_index) { printf( n \n Warning: Unable to find place in Lt. c 

} 

for ( ; i ; — i ) 

{ • . 

x2 = boundary[i] .xl; 

v_index = diagonal_walk(grid, i, vec, boundary, &min_p, &max_p, x2); 
30 anal_vec( vec , v_index, min_p, raax_p, boundary [ i ] . y , x2 # res); 

) 

for (x2 = boundary[0] .xl ; x2 < boundary[0] ,x2 ; ->-+x2) 
( 

v_index = diagonal_walk(grid , 0, vec, boundary, &min_p, Smax_p ( x2); 
anal_vec( vec, v_index, inin_p, max_p, boundary[ i ] . y , x2 , res); 

} 

35 for (i « 0 ; i < boundary_index ; ++i) 

( 

x2 = boundary [i ] . x2; 

vindex = diagonal_walk(grid , i, vec, boundary, &min_p, &max_p, x2 ) ; 
ana l_vec ( vec , v_index , min_p , max_p , boundary [ i ] . y , x2 , res ) ; 

J 

) 

diagonal_walk(grid, i, vec, boundary, min pp, maxpp, x2 ) 
PIXEL grid[FR_Y_SI2E] [FR_X_SI2E] ; 
struct line^pair boundary [ ] ; 
unsigned char vec [ ] ; 
int *min_pp, *raax_pp; 

{ 

int y,j,l f xl, v_index, min_p, max_p; 
y = boundary [ i] .y; 
45 if (debug__f lag) wpixel(x2, y, 255); 

v index = 0 ; 
mlnp = 255; roax_p =0; 

for (j = x2-l , 1 - y; grid[l][j) ; — j, ++1 ) 
{ 

if (debug_flag == 2) wpixel( j , 1 , 254 ) ; 
vec [ v_index ) = grid[ 1 j [ j ] ; 
50 if ( vec( v_index] > max_p) max_p = vec[v_index] ; 

else if ( vec[ vindex] < minp) minp = vec[ v_index] ; 
++v_index ; 

) 

*min_pp = min_p; 
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*max_pp = max_p; 
return ( v_index ) ; 

} 

?endif 

anal vec(vec, v index, yO r xO, res, mark) 

PIXEL res[FR_Y_SIZE][FR_X_SIZE]; 
unsigned char vec[ ] ; 
unsigned char markf]; 

{ 

int i, 1; 
^define N 2 

if (v_index < 4) return(l); 

for (i = N ; i < v_index-N ; ++i) 

{ 

1 = vec[i+l]-vec[i-l] ; 
if (1 < 0) 1 = -1; 
20 if (1 < 8) continue; 

if (vec[i] > vec[i-N] && vec[i] > vec[i+N] && vec[i] > 10) 
mark[i] = 1; 
else mark[i] = 0; 

mark_suspicious_intervals(mark,v_index, yO, xO, res, vec); 
if (debug_flag) 
25 ' draw_data(v_index, mark, yO, xO, xo); 

mark suspicious_intervals (markl , v_index, yO, xO, res, mark) 
PIXEL res[FR_Y_SIZE][FR_X_SIZE3; 
unsigned char markl[]; 
unsigned char raark[]r 

( 

30 int i,j, r, 1; 

v_index - ( int )( (double )v_index * 0.8); 
for (i = 1 ; i < v index-1 ; ++i) 

if ( markl(i-l] || markl[i+l] || markl[i)) 

mark[i] = 1; else mark[i] = 0; 
for (i = 1 ; ! mark[ij && i < v_index ; ++i ) ; 
for (i += 2 ; i < v_index ; ++i) 
35 ( 

for (j = i ; ! mark[j] && j < v_index ; ++j) ; 
if (j == v_index) continue; 
r = 0; 

if (j-i >= CALYX_GAP) { 

if (debug_flag) { wpixel (xO+ j ,y0 , 253 ) ; wpixel (xO+i , yO , 254 ) ; ) 
for (1 = i j 1 < j ; ++1) 
40 res[y0][x0+l] = 253; 

for (1 = j ; markf 1] && 1 < v_index ; ++1 ) ; 
if (1 — v_index) continue; 
for ( ; mark[l] — 0 ; ++1) 

res[y0] [x0+l] = 253; 

J else { res[y0][x0+i] = 100; ) 
45 i = 3+1? 

) 

for ( ; i < FR_X_SIZE ; ++i) res [ yO ] [ xO+i ] = 99; 

) 

draw_data(v_index, mark, yO, xO, x_base) 
unsigned char markf ] ; 

{ 

int i; 
^define X 0 
#define Y 200 
^define SIZE_X 256 
#define SIZE_Y 256 
static int height - SIZE_Y; 
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wpixel(xO, yO, 253); 

if (height == SIZEY) f illed_rectangle(X, Y, X+SIZEX , Y+SIZE_Y, 60); 
for ( i = 1 ; i < v_index ; +-f-i ) 
10 , 

if (mark[i] == 1) wpixel(X+i+x_base, Y+height, 255); 
if (mark[i] == 2) wpixel ( X+i+x_base , Y+height, 253); 

) 

height -= 1 ; 

) 

grow( iO , jO ) 
15 { 

double r_g; 

if (iO < O | | jO < 0 | | iO >= FR_Y SIZE j| jO >= FR_X_SIZE) retum(l); 

r_g = ( double) red [ iO j [ jo ) / { double) green [ iO ][ jO] ; 
if ( (green[iO][ jo] < 125 && red[iO][jO] < 125 && aa[iO][jO] < 150 
&& grid[iO][jO] J = 200 && r_g > 1.10 )) { 
grid[i0] [ jO) = 200 ; 

if (rec_depth > MAX_RECURSE) { return(O); j 
20 ++rec depth; 

grow(iO-l, jO); 

grow(iO+l, jO); 

grow(iO, jO+1); 

grow(iO, jO-1); 

grow(iO-l, jo-l); 

grow(i0+l, jO-1); 
25 grow(iO-l, jO+1); 

grow(io+l, jO+1); 

--rec_depth; 

) 

) 

30 



APPENDIX 

35 



40 



45 



50 



55 



69 



EP 0 566 397 A2 



ID: 010 

10 File name is: applO.c 



*/ 

#include "adapter. h M 
# include <math.h> 
^include <stdio.h> 

extern struct single_view_inf o view_inf o[N_CAMERAS] ; 
15 static FILE *out_file; 

extern struct prog_settings prog_consts; 

extern int debug_flag; 

double 

coropute_single_cam(cam, bnd, image, camera_distance) 
int cam, camera_distance ; 
struct boundary_data *bnd; 
20 PIXEL image [ FR_X_S I2E ] [ FR_Y_SI Z E ] ; 

{ 

int xl # x2, y, ret, x, i, xlz, x2z, old, min_x, inax_x; 
double volume , area ; 
float radius, y_height; 

if (debug_flag) { old = get_channel( ) ; set_channel ( cam) ; } ' ~ 
volume « 0; 
25 min_x = L_FR_X_SIZE; 

max_x = 0; i 

for (i = l; i < bnd -> boundary_index-i ; ++i) 

{ 

y = bnd -> boundary f i ] .y ;' • ■* j * - * 
xl = bnd -> boundary [ i] .xl; 
x2 = bnd -> boundary [ i J. x2 ; 
30 compute_radius(y , xl , x2, Sradius, &y_height, camera_distance) ; 

set_zone_bounds ( radius , y, xl, x2 , &xlz, &x2z, camera_di stance ) ; 

area = 3 . 1415*radius*radius ; 

volume += (area * y_height) ; 

if (debug_flag) { wpixel(xlz, y, 254); 

wpixel(x2z, y, 255); 
wpixel(bnd->boundary[ i] .xl , y, 150); 
35 wpixel(bnd->boundary[i] .x2, y, 151); 

} 

if (xlz < min_x) min_x = xlz; 
if (x2z > max^x) max_x = x2z; 
bnd -> boundary [ i ] . xl = xlz; 
bnd -> boundary [ i ] .x2 - x2z; 

> 

40 bnd->out_rect.xl = min_x; 

bnd->out_rect.x2 = max_x; 

if (debug_flag) { set_channel(old ) ; 

pr intf ( "\n Volume : %f 11 , volume ) ; 

) 

return ( volume ) ; 

) 

45 glob_all (bndO f bndl , bnd2, imageO , imagel , image 2 , volp) 

PIXEL imageO [ FR_Y_SIZE ] [ FR_X_SIZE ] ; 

PIXEL imagel [ FR_Y_SIZE ] [FR_X_SIZE] ; 

PIXEL image2[FR_Y_SIZE] [FR_X_SIZEJ ; 

struct boundary_data *bnd0; 

struct boundary_data *bndl ; 

struct boundary_data *bnd2 ; 
50 double *volp; 

{ 

double copmute_single_cam( ) ; 
double t_volume, volume; 
char header [ 32] ; 

t__volume = 
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compute_single_cani(CAM_l , bndO, imageO, prog_consts . camera_distance[ CAM_1 
10 t_volume += 

compute_single_cam(CAM_2 , bndl, imagel, prog_consts . camera_distance [ CAM _2 
t_volume += 

compute_single_cam(CAM_3 , bnd2, image2, prog__consts .camera_di stance [CAM_3 
tvoluine /= 3 . ; 
*volp = t_volume; 
return (SUCCESS); 

15 ) 

as sign_global_coordinates_tr( radius, yl, xl , x2 , cam_number , ca m_dista nee , 

y_center, x_c enter) 

double radius; 

{ 

int xc; 

float x f y, z; 

xc - (x2 + xl) >> 1; 
for (++xl ; xl < x2 ; xl += 3) 
( 

glob_coord_single_point(cam_number, yl , xl, xc, y_center, 

radius, &x, &y, &z, caro_distance , x_center, y_center); 

) 

return (SUCCESS) ; 

25 #define PERSPECTIVE^ ( world_coordinate , cam_coordinate , Z) \ 

world_coordinate = (double) ( cara_coordinate ) * CCD_SIZE_X / CCD_RESOLUTlON_X; \ 
world_coordinate = world_coordinate * (Z - CAM_FOCAX._L.ENG TH ) / \ 

#define PERSPECTIVE_Y(world_coordinate, cani_coordinate , Z) \ 

. world_coordinate = ( double )( can>_coordinate ) * CCD_SIZE_Y / CCD_RESOLUTION_Y; \ 
world_coordinate = world_coordinate * ( Z - CAM_FOCAL_LENGTH ) / \ 

30 

world_coordinate *= 1 . 04 ; 
compute_radius ( y , xl, x2, rp, y_height, cam_distance ) float *rp 

{ 

double a,b; 
int w; 

/* 1. compute radius in mm ( world coordinates) * 
35 w = (x2-xl) » 1; 

PERSPECTIVE_X ( b , w, cam_distance ) ; 
*rp = (float)b; 

PERSPECTIVE_Y ( a , 1, ( cam_di stance- *rp )) ; /* compute height of 1 p 
*y_height = (float) a; 

) 

#define PERSPECTIVE_X( world_coordinate , cam_coordinate , Z) \ 
world_coordinate = ( double )( cam_coordinate ) * CCD_SIZE_X / CCD_RESOLUTION_X ; \ 
40 world_coordinate = world_coordinate * (Z - CAM_FOCAL_LENGTH ) / \ 

glob_coord_single_point(cam_number, yl, xl, xc, yc, radius, xp, yp, zp, 

cam_di stance , y_c 

float *xp, *yp, *zp; 

double radius ; 

int xc, yc, yl , xl; 

45 { 

double s, f, a, b, c, q,*z, x, y; 

f = C AM_F0C AL_LENGTH ; 
s = (double) (xl - xc); 

s = s * CCD_SIZE_X / CCD_RES0LUTION_X ; 
s = s * s; 
a = s / (f*f ) +■ 1 . ; 
50 b = 2.*radius - 2 . *cam_distance - 2.*s/f; 

c = s + cam_distance*(cam_distance-2<.*radius) ; 
q - -0.5 * (b - sqrt((b * b) - (4.0 * a * c))); 
z = c / q; 

PERSPECTIVE_X(x, (xl-x_center ) , z); 
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PERSPECTIVE_Y ( y , ( yl-yc ) , z ) ; 
z — cam_distance-radius-z ; 
if ( cam_n umber = CAM_1 ) ; 

if ( cam_number == CAM_3 ) 
{ 



rdefine SIN120 0.866 
^define COS120 -0.5 
^define SIN240 -0.866 
^define COS240 -0.5 
* define PLANE_X_Z 
#ifdef PLANE_X_Z 



*endif 

#ifdef PLANE Y 



iendif 



s = (float)x; 

x = -(z - 0)*SIN120 + x*COS120; 
(z - 0)*COS120 + s*SIN120; 



s = (float)y; 
y = - ( z - 0)*0. 
- (2 - 0)*(-0.5) 



866 + y*(- 
4- s*0.866; 



0.5); 



) 

else if ( cam_n umber == CAM_2 ) 
{ 

s = ( float )x; 

x = -(z - 0)*SIN240 + X*COS240; 
z = (z - 0)*COS240 + s*SIN240; 
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Sifdef NEW 

* define PLANE_X_Z 

#ifdef PLANE X Z 



*endif 

Sifdef PLANE Y 



#endif 



ftendif 



x = 



( float )x; 

-(z - 0)*0.866 



+ x*(-0.5); 



0)*(-0.5) + s*0.866; 



s = (float)y; 
y = -( z _ o)*0. 
(z - 0)*(-0.5) 



866 + y*(- 
+ s*0.866; 



0.5); 



) 

else if ( cam_number == CAM 2) 



s = (float)x; 

X = -(z - 0)*(-0.866) + x*{0.5); 
(z - 0)*(0.5) + s*(-0.866); 



y « -y; 

*xp = ( float )x; 
*yp = (float )y; 
*zp = (float) z; 
return ( SUCCESS ) ; 



} 

set_zone_bounds ( radius , 



y, xl, x2, 
int *xlzp, 



xlzp, x2zp, cam_distance) 
*x2zp; 



double p, v, 
int pixels; 



double radius ; 

d2, f, s, alfa; 

f = CAM_FOCAL_LENGTH; 

w = radius * sin(60 * PI / 180.); 

d2 = cam_distance - f - radius * (1. + sin(30 * PI / 180.)) 
p = w * f / d2; 

pixels = (int) (p * CCD RESOLUTION X / CCD SIZE X + 0.5); 
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*xlzp = ( (xl+x2) » 1) - pixels; 
*x2zp = ((xl+x2) » 1) + pixels; 
return (pixels ) ; 
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ID: 009 

File name is: app06.c 



V 

# include "adapter . h" 
^include <limits.h> 
£ include <stdio.h> 
y - ^define STEM 

extern struct prog_settings prog_consts; 

extern int debug_flag; 

extern int norm_r aw [ N_CAMERAS ] [ 4 ] ; 

raake_rouler_p(xs,ys,xend,y end, step, grade, header , cl ,c2 ) char *header; 

( 

global_color_analysis ( cam_num, bnd , green_image , red_image , grid_image , color_mask , 
20 ~~ Dark_Red ,Simple_Red, Yellow, Green , Orange, Sat, Changes , no 

int cam_num , apple_brand , no_color ; 

long *Dark Red , *Simple_Red, * Yellow, *Green , *0range , *Sat, *Changes , * 

P IXEL red_Image [ FR_Y_S I ZE ] [ FR_X_S I Z E ] ; 

PIXEL green image[ FR_Y_SIZE] [ FR_X_SIZE] ; 

PIXEL gr i dlmage [ FR_ Y_S IZE ] [ FR_X_S I Z E ] ; 

PIXEL color_mask[FR_Y_SIZE] [FR_X_SIZE] ; 

25 struct boundary_data *bnd; 
{ 

int i,j,max_y,r; 
PIXEL Level thresh: 

float R_Gd , G_Gd , RTL , RTM , RTH , GTL , GTM , GTH , satu=0.; ■ "' 

#def ine SAMPLE_STEP_SIZE 2 
switch ('apple_brand ) { 
30 case SMITH_TYPE: 

i 

Level_thresh=SMITH_GRID_THRESH ; 
RTL=SMITH_RED_THRESH__LOW ; 
RTM=SMITH_REDJTHRESH_MEDIUM ; 
RTH =SM I TH_RED__THRE SH_H IGH ; 
GTL=SMITH_GREEN_THRESH_LOW ; 
35 GTM=SMITH_GREEN_THRESH_MEDIUM; 

GTH=SMITH_GREEN_THRESH_HIGH ; 

break; 

) 

case HERMON_TYPE: 
case ANA_TYPE: 
case ORLEANS_TYPE : 

40 Level_thresh=ORLEANS_GRID_THRESH; 

RTL=ORLEANS_RED_THRESH_LOW ; 

RTM=ORLEANS_RED_THRESH_MED IUM ; 

RTH=ORLEANS_RED_THRESH_HIGH ; 

GTL=ORLEANS_GREEN_THRESH_LOW ; 

GTM=ORLEANS_GREEN_THRESH_MEDIUM ; 

GTH=ORLEANS_GREEN_THRESH_HIGH ; 
45 break ; 

} 

) 

for (i=0 ; i < FR_Y_SIZE ;i+-r) 

for (j=0 ; j < FR_x_SlZE color_mask[ i ] [ j ] =0 ; 

r=l? 

max_y=bnd->boundary[ bnd->boundary_index-l j .y-r ; 
50 for (i=bnd->boundary[r] .y ; i < max_y ; i+=SAMPLE_STEP_SIZE) 

( 

for ( j=bnd->boundary[r] .xl+2 ; ] <= bnd->boundary[r ] .X2-2 ; j+=SAMPL£_STEP 
{ 

if (grid_image[ i] [ j ] > Level_thresh ) 
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{ 

R_Gd-red_image ( i ] ( j ]/( float )grid image [ i ] ( j ] ; 
10 G_Gd=green_image [ i ] [ j ]/( float )grxd__image[i ] [ j] ; 

if (R_Gd <= RTL && G_Gd <= GTL) 
( 

color_inask[ i ] [ j ]=DARK_RED_COLOR; 
{ * Dar k_Red ) ++ ; 

if { R_Gd < 0.7) satu+=(0. 7-R_Gd) ; 
) 

15 else if (R_Gd <= RTH && G_Gd > GTH) 

{ 

color_mask[ i ] [ j ] =GREEN_COLOR ; 

( *Green ) ++ ; 

> 

else if (R_Gd > RTH && G_Gd > GTH) 
{ 

20 col or_ma sk [ i ] [ j ] = YELLOW_COLOR ; 

(* Yellow )++; 
J 

else if (R_Gd > RTM && G_Gd > GTM && G_Gd GTH) 
{ 

color_mask [ i ] [ j ] =ORANGE_COL0R ; 
( * Orange )++; 

25 > 
else 

{ 

colorjnask [ i ] [ j ] =SIMPLE_RED JTOLOR ; 
(*Simple_Red)++; 

if (color_mask[i -SAMPLE _STEP_SIZE] [ j ] ]= SIMPLE_RED_COLOR. ) 

(*Changes)++; 

30 if (color_mask[i] [ j-SAMPLE_STEP_SIZE] 1= SIMPLE_RED_COLOR ) 

( * Changes ) ++ ; 
if { R_Gd < 0.7) satu+= ( 0 . 7-R_Gd ) ; 
) 

) 

else (*no_color)++; 
} 

r+=SAMFLE_STEP_SIZE ; 
) 

satu/=(f loat) ( (*Simple_Red) + ( *Dark_Red ) ) ; 
satu-=0 . 2 ; 

if (satu <= 0. ) satu= 0.01; 
satu/=o . 07 ; 

(*Sat)+= (long) ( satu*33. +0.5); 

AO > 
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File name is: appl2.c 



*/ 

#define SUR 2 
#include <math.h> 
^include <stdio.h> 
^include <conio.h> 
# include <malloc.h> 
#include <memory.h> 
#include <fcntl.h> 
^include <limits.h> 
^include "adapter. h" 

extern struct single_view_inf o view_inf o [N_CAMERAS ) ; 
extern struct prog_sett ings prog_consts; 
exterr. int debug_flag; 

extern struct c_dat candidates IMAX_CANDIDATES] ; 
extern int cand_index; 

do_bruse_l (cam, bnd, imageO, imagel, image2, image3, image4, image5, spots) 
int cam; 

PIXEL imageO [FR_Y_S IZE] [FR_X_S IZE] ; * ' 

PIXEL imagel [FR_Y_S I 2E] [FR_X_SIZE]; 
PIXEL image2 IFR_Y_SIZE][FR_X_SIZE] ; 
PIXEL image 3 [FR_Y_SIZEj {FR_X_SIZE] ; 
PIXEL image4 IFR_Y_SIZE] tFR_X_SIZE] ; 
P I XEL image 5 I FR_Y_S I ZE ] [ FR_X_S IZE] ; 
struct boundary _dat a *bnd; 
struct spot spots (MAX_SPOTS] ; 



I 

int 
int 



old, n, i, spt_index; 
ret, old_debug; 
char s{16] ; 

old_debug =* debug_flag; 
debug_flag =0; 

old = get_channel <) ; 
if (debug_flag) set_channel (cam) 

SWAP_IN_SIZE (imagel , cam, 
SWAP_IN_S IZE ( image 2 f cam, 
swap_in_size (image 3, cam, 
SWAP_IK_S I ZE ( image 5 , cam, 
SWap_in_SIZe (bnd, cam, 
#define SH 3 

clear_outside_ margin (imagel, bnd->boundary, 
divide_l (image3, image5, imageO) ; 
clear_outside_margin (imageO, bnd->boundary, 
do_smooth_masked (imageO, image2); 
change_background(image2) ; 
dialate_color (image2, imageO, 255); 
SWAP_IN_SIZE (image2, cam, norma l_images . red, FR_Y 
SWAP_IN_SIZE (image5, cam, norma l_images .grid, FR_Y~ 
±f (debug_f lag ! I old_debug) 
display_plain_magnif ied_3 (0, 0, imageO, FR_X_SIZE, FR 
spt_inclex - ret - cntr (imageO , imagel, image2, image3," 
cam, image4, spots, image5) ; 

if (debug_f lag) 



normal_images .green, FR_Y_SIZE*FR_X_SIZE) ; 
normal^images -red, FR_Y_SIZE*FR_X_SIZE) ; 
normal_images .ir, FR_Y_SIZE*FR_X_SIZE) ; 
normal_images . grid, fr_y_size*FR_X_SIZE) ; 
bnd, sizeof (struct boundary_data) ) ; 

bnd->boundary_index, 255, SH) ; 

bnd->boundary_index, 255, SH) ; 



SIZE* FR_X_S IZE) ; 
*SIZE*FR_X_SIZE) ; 

Y SIZE) ; 
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display_image<4 32, 0, image4, FR_X_SIZE, FR_Y_SIZE, "final"); 
sprint f(s, "SPT_* Id. dat ", cam) ; 
15 dump_spots (3, spots, sizeof (st ruct spot) * MAX_SPOTS, Aret); 

if (debug_flag) 
{ 

set_channel (old) ; 

» 

select_contour_l (spots, spt_index, R£AL_BLSMISH, 100, cam); 
for (i - 0; i < spt index ; ++i> 

7(i { 

decide_about_cont our (spots, i, 0, cam); 

> 

debug_flag - old_debug; 

choose_sefects_by_severicy (spots, spt_index, cam) ; 
return (sptindex) ; 

} 

dump_spots (name, buf, size, count) unsigned int size; char *buf 

25 int * count; char 'name; 

{ 

int out_file; 
unsigned int bw; 

out_file - open (name, (0_WRONLY | o_CREAT I 

0_TRUNC I 0_BINARY), (0200 I 0400) ); 
if (out_fxle — -1) return (FAILURE); 
bw - write <out_file, buf, size); 
30 if (bw i=* size) i close (out_file) ; return (FAILURE) ; } 

bw = write (out_file, count, sizeof (int )) ; 

if (bw != sizeof (int) > { close (out_file) ; return (FAILURE) ; } 

close (out_file) ; 
return (SUCCESS) ; 

} 

cntr (spot_image, green, red, ir, cam, whtg, spots, grid) 
int cam; 

35 PIXEL whtg[FR_Y_SIZE) [FR_X_SIZE) ; 

PIXEL spot_image ( FR_Y_S IZE] [ FR_X_S IZEJ ; 
PIXEL green[FR_Y_SIZEJ [FRXSIZE]; 
PIXEL grid[FR_Y_SIZE3 [FR_X_SIZE]; 
PIX2L red[FR Y_SIZE][FR_X_SIZE] ; 
PIXEL ir tFR_Y_SIZEj(FR_X_SIZE] ; 
struct spot spots [MAX_SPOTSJ ; 

M int n; 

int sp_index; 

int start_i, start_j, per, level, offset, ci, cj, ret; 
char chain [2048 J , c name [16]; 
long measure_chain_area (PIXEL *chain) ; 
int area, old_area; 
struct spot spotl; 
^ int xl, yl, x2, y2, angle, al, bl; 
struct point xybuf[2048); 

offset - 0; 

sp_index - 0; 

init_contours (spot_image, whtg, 1, 

1. FR_Y_SIZE-2, FR X SIZE-2); 
per ° 1; ~ 
#define LEVEL_STEP 3 
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for (level - 2C0 ; level > 20 && sp_index < (MAX SPOTS- 1) ; ) 
i 

if (kbhitO) { getchO; return (0); } 

per - next_contour (level, &start_i, &start_j, &chain[0]>; 
if (per — 0) { level — LEVEL_STE? ; continue;} 
area = (int )measure_chain_area (& chain {0] ) ; 
if (area < -10 && area > -5600) { 
spot 1. area - ABS(area); 
spotl.per - per; 

mal_contour_features <start_i, start_j, &chain[0], sspotl); 
20 enciosing_rectangle_chain (schain 10] , start_i, star* j, &xybuf[0], Sxl, &yl &x2 

spotl.al - x2 - xl + 1; 
spotl.bl - y2 - yl + 1; 
spot 1 . cam_number = cam; 

al - (spotl.al > spotl.bl) ? spotl.al : spotl.bl; 
bl - (spotl.al < spotl.bl) ? spotl.al : sootl.bl; 
spotl.ar - (bl > 0 ? (float )al / (float) bl : 0.); 
if (debug_fiag) { 

25 draw_contour (of f set+start_i, start_j, chain, 3, 1) ; 

if (1) 

( 

old_area - spotl.area; .... 
do_stati'stics (cam, green, red, ir, grid, sspotl); 

do_statistics_ring(cam, green, red, ir, grid, sspotl, - & chain )■; " 
spotl.area «=» old_area; 
30 if (spot 1 .area !» 0) 

spotl. p2a =• ( (flcat)spotl.per * (f loat ) spotl .per ) / (4.0 * PI * (float ) spot 1 . area) ; i 
memcpy (fispots (sp_indexj , &spotl, sizeof (struct spot)); 
sprint f(c_name, ,, *s%ld_%ld. cnt", TMP_DEVICS, cam, sp index); 
dump_spots (c_name, chain, sizeof (chair.) , sper) ; ~ 
if (debug_flag) 
draw_contour (of f set+start_i, start_j, chain, 3, 254); 
sp_index++; 

35 if ( (sp_index) >= MAX_SPOTS) ( 

cputs ("\nToo many spots"); return (sp^mdex) ; } 

} 

> 

return (sp_index) ; • 

r 

mal_contour_features (i, j, chain_buf, spotl) 
int i,j; char "chain_buf; 
struct spot 'spotl; 
{ 

char *p - &chain_buf [ 0 J ; 
double or; 

int min_i, max_i, min_j, max_j; 
long cci, CC]; 

mln_i - min_j « FR_X_SIZE; 

max _i = max_j = 0; 
cci - ccj - 0; 

spotl->start_i = (unsigned char)i; 

spotl->start_j = (unsigned char) j; 

for ( ; *p ; ++ P ) 

{ 
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cci +- i; 
ccj +- 3; 

if (i < min_i) min_i = i; 

if (i > maxi) max_i - i; 

if (j < min_j) min_j - j; 

if (j > maxj) max_j - j; 

switch (*p) 

{ 

case 'IT : — i ; break; 

caae ' D' : ++i ; break; 

case ' L' : — j; break; 

case 'R' : ++j ; break; 
default: : 

print f < M \n Illegal"); exit(0); 

\ 



} 

<spotl->per != 0) 



{ 



spotl -> ci 
spotl -> cj 



(unsigned char) ( (double) cci / 
(unsigned char) ( (double) ccj / 



(double) spot l->per + 
(double) spot l->per + 



0.5) ; 
0.5); 



(unsigned char)min_i; 

(unsigned char)max_i; 

(unsigned char )min_j; 

(unsigned char)max_j; 



spotl -> min_i 
spotl -> max_i 
spotl -> min_j 
spotl -> max_j 

spotl ->flagl - 0; 

spotl ->flag2 - 0; 

spotl ->flag3 - 0; 
return (SUCCESS) ; 

} 

#ifdef S_ALONE 
do_sraooth_masked (src, dst) 

PIXEL src[ J IFR_X_SIZE] ; 

PIXEL dst ( } [FR_X_SIZE] ; 

{ 

int i, j, cnt; 
unsigned int n, p; 

for (i - 1 ; i < FR_Y_SIZE-1 ; ++i) 
for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 
{ 

p - srcEi) [j]; 

if (p < 253) < n 

else { dst [i] { j J 
^define ADD_C0ND4 (a, b) p 
^define ADD_COND8 (a, b) p 

ADD_C0ND4 (i, j-1) ; 

ADD_C0ND4 (i-l r j); 

ADD_C0ND4 (i+1, j>; 

ADD_C0ND4 (i, j+1); 

ADD_C0ND8 j-1) ; 

ADD_COND8 (i-1, j+1); 

ADD_COND8 (i+1, j-1) ; 

ADD_COND8(i+l, j + 1) ; 

n - (int) ( (double )n / (double)cnt + 0.5) 
dst UJ I 3 J - (PIXSL)n; 

} 



p « 2; cnt - 4; } 
(PIXEL)p; continue; } 
src[a] lb] ; if (p < 253) 
arc [a) [b] ; if (p < 253) 



{n += 
(n +- 



(p « 1); cnt 
p; cnt 



f- 2;} 
1;» 
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return (1 ) ; 

15 I M . „ 

fendxf 

change__background (image) 

PIXEL image [FR_Y_SIZE] [FR_X_SIZE); 

{ 

int i, j; 

for (i - 0 ; i < FR_Y_SIZE ; ++i) 
for (j - 0 ; j < FR_X_SIZE ; 
20 if <image[i)[3) > 253) image[i)Ij] =• 255; 

} 

divide_l (divl, divisor, result) 

PIXEL divl (FR_Y_SIZE] [FR^X_SIZE]; 
PIXEL divisor [fr_y_S I ZE] [FR_X_SIZEj; 
PIXEL result [FR_Y_SIZE] [?R_X_SIZE] ; 

i 

int i,j; 
25 double dl, d2, d3; 

for {i - 0 ; i < FR_Y_SIZE ; ++i) 
for (j = 0 ; j < FR_X_SIZE ; 
< 

if (divl [i] [ j] > 253) ( 

result [i] Tjl - divl[i] [j); 
continue; 

) 

if (divisor [i] [ j] > 253) { 

result [i] lj] - divisor [i }[ j ] ; 
continue; 

) 

#define VERY_DARK 110 

if (divisor [ij tj3 < VERY_DARK || divl[i][j) < VERY_DARK) 
result [i] [ j] = 70; 
continue; 

} 

dl - (double ) divl [i](j] ; 
d2 =» (double) divisor (i) [ j] ; 
if (d2 < 1.0> d2 - 1.0; 
d3 - dl / d2; 

d3 » d3 * 100. + 0.5; 
if (d3 > 250.) d3 - 250.; 
40 result[i][j] = (PIXEL)d3; 

} 

clear_outside_margin (image, boundary, boundary_index, color, margin) 
PIXEL image [FR_Y_SIZE) rFR_X_SIZE] ; 
struct line_pair boundary []; 

{ 

int i, y, xl r yl, j, x2; 
45 printf("\n Id %d M , boundary_index, margin); 

for (i = 0 ; i < boundary_index ; ++i) 

< 

y - boundary [ij .y; 
if (y < 0 I I y >• L_FR_Y_SIZE) continue; 
xl = boundary [i] .xl + margin; if (xl < 0) xl - 0; 

x2 - boundary (i] .x2 - margin; if (x2 > FR_X_SIZE> x2 — FR X SIZE 
50 if (xl > x2> { 
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xl = boundary [il . xl; 
15 x2 - boundary [i] .x2; 

) 

if (xl - 0 « x2 =- FR_X_SIZE) 

for (j « 0 ; j < x2 ; ++j) imagetyHjl = color; 

else { 

for (j - 0 ; j < xl ; image [ y ][ j ] - color; 

for (j = x2 ; j < FR_X_SIZE ; ++j) image [y] [}] = color; 

for (y - 0 ; y < boundary [0] . y ; ++y) 
for (j - 0 ; j < FR_X_SIZE ; 

imagefyHj) - color; 
for (y - boundary [boundary_index-l ) .y ; y < FR_Y_SIZE ; ++y) 
for (j - 0 ; j < FR_X_SIZE ; ++3> 

image [yj[j) - color; 

} 

25 do_statistics (cam, greer., red, ir, grid, spot) 

int cam; 

PIXEL green [FR_Y_S IZE] (FR_X_SIZE]; 
PIXEL red[FR_Y_SIZEJ (FR_X_$IZEJ ; 
P IXEL ir [ FR_Y_S IZE ) [ FR_X_S IZE ) ; 
PIXEL grid[FR_Y_SIZEJ [FR_X_SIZE] ; 
struct spot *spot; 

30 1 

M int i, j; 

float rg, rr, ri, rgrid; 

int n, ret; 

) 

count_spot_point { i, j, image, sum, r, min, max, area) 
int i, j, ♦area; 
unsigned char *min, *irax; 
float »sum, *r; 

pixel image (FR_Y_S IZE] [FR_X_SIZE]; 

i 

♦sum =*sum + (float) ( image lij (jj ) ; 

*r = *r + (float) ( imageUHj]) • (float) ( imageUM}]) 
♦min = ( (*xain < imageUHj)) ? *min : image[i][j] ); 
*max - ( (-max > image [i]Ij]) ? *max : image (i] { j] ); 
*area - ♦area + 1; 
An return (0); 

) 

do_statistics_rir.g (cam, green, red, ir, grid, spot, chain) 
int cam; 

PIXEL green [FR_Y_S IZE] (FR_X_SIZE); 
P IXEL re d { FR_Y_S IZE] [ FR_X_S IZE ] ; 
PIXEL ir[FR_Y_SIZE] (FR_X_SIZEJ ; 
PIXEL grid fFR_Y_S IZE] [FR_X_SIZE] ; 
45 struct spot *spot; 

char * chain; 

{ 

int i, j, n, pi, p2, p3, p4, d, di, dj, ci, cj, dist_center; 
char *p; 

unsigned long sum_green, sum_red, sum_ir, sum_grid; 
♦define SIGN (a) (a < 0 ? -1 : (a > 0 ? 1 : 0) ) 
int gl, g2, g3, g4, per; 
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spot->flag_g = 0; 
dist_center - 2; 
count_cgl (green, 
count_cgl (red, 
coun.t_cgl (ir, 
count_cgl (grid, 

#define NEW 

#ifdef NEW 
. ci = spot->ci; cj 



spot->ci, 
spot->ci, 
spot->ci. 
spot->ci. 



spot->c j, 
spot->cj, 
spot->c j, 
spot->c j. 



£spot->green_cgl, 
&spot->red_cgi, 
ispot->ir_cgl, 
&spot->grid_cgl. 



dist_center) ; 
dist_center) ; 
dist_center) ; 
dist_center) ; 



spot->c j; 

i - spot->start_i; j - spot->start_ j; 
sum_green - 3ura_red - sum__ir - sum_grid 
n - 0; 
per - 0; 
for (p 
{ 



0; 



chair. 



*P ; 



case 
case 
case 
case 
} 



switch (*p) 
\ 

U' : 
D* : 



— i ; break; 
++i ; break; 
— j; break; 
++j ; break; 



++per; 

d - (i-ci); di - SIGN(d); 
d - (j-cj) ; dj - SIGN(d) ; 
di - 6*di; 
dj - 6*dj; 

pi = green(i+di] ( j+dj) ; 
p2 - redU+di] I j+dj]; 
p3 = irfi+di] [j+djj; 
p4 = grid {i+di ][ j+dj] ; 



if (pi > 253 
if (pi < 1 | 
sum_green += 
sum_red +- 
sura_ir +- 
sum_grid +- 
++n; 

gl = -(ir[i] { j) 
g2 = -(ir[ij [ j] 
g3 = -<ir[i] I j) 
g4 » -(ir [i) [ j] 
if (g2 > gl) gl 
(g3 > gl) gl 



1 



if (g3 > gl) gl - g3; 
if (g4 > gl) gl - g4; 
spot->mate = gl ; 
if <debug_flag) 

wpixel(3* (j+dj) , 



I I p2 > 253 I I p3 > 
p2 < 1 11 p3 < 1 I 

Pi; 

P2; 
P3; 
p4; 



irU-2] [jj) 
irti+2] { j)) 
ir[i] { j-2]> 
ir[i] tj+2)) 
c2 



253 
P4 



I p4 > 253) cor.tinue; 
1) continue; 



3* (i+di), 0); 



if (n > ( (per >> 1) ) ) { 

spot->grid_ar_mean - (PIXEL) < (double) sum_gr id / (double)n + 0.5); 
spot->g_ar_mean = (PIXEL) ( (double) sun_green / (double)n + 0.5); 
spot->r_ar_mean » (PIXEL) ( (double) sum_red / (couble)n + 0 5); 
spot->i_ar_mean » (pixel) ( (double) sum_ir / (double)n + 0.5); 

else ( 
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spot->grid_ar_mean = 0 
spot->g_ar_mean = 0 

spot->r_ar_mean - 0 

3pot->i_ar_mean = 0 

> 

#er.dif 

return (SUCCESS) ; 

} 

count_cgl (image, ci, cj. cgl. dist_center) 
PIXEi. image[FR_Y_SIZE) [FR_X_SIZEJ; 
unsigned char ci, cj, *cgl; 



25 



int i, j, sum, n; 
unsigned char min; 

min - 255; 

sum = C; 

n - 0; 

for (i - (int) (ci - dist_center) ; i < (int) (ci + dist center); i++) 



for (j = (int) (cj - dist_center) ; j < (int) (cj + dist_center) ; 
if (image (i J [ j] < min) min = image [ i J [ i ] ; 



30 
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40 



*cgl - min; 
return (1) ; 

} 

count_sd (r, area, mean, sd) 
int area; 

unsigned char *mean; 
float *r, *sd; 



{ 



if (area 



0 ) 



*r - *r / (float) (area) ; 

-mean - (unsigned char) <*r + 0.5); 

*sd - (area > 1) ? 

(*sd - *r * *r * (float) (area) J / (float) (area - 1) : 0.0 ; 
if (*sd < 0.0) 

{ 

•Sd = 0.0; 

! 

*sd - sqrc (-sd); 



return (-2); 



45 



50 



return (SUCCESS) ; 

) 

idefine IMAGE_X fr_X_SIZE 
i define IMAGERY FR_y_£IZE 
#define D0WN_BIT 8 
#define RIGHT_BIT 1 
^define UP_bit 
#define left_bit 4 
#define ALI,_BITS 
#define up_arrow 
#define DOWN_ARRCW 
^define LEFT ARROiv 



( UP_B I T I DOWN_B I T | LEFT_3I T I RIGHT 3 1 T ) 
'U' " ~ 

' D' 
' L' 
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^define R I G H T_ARROW ' R' 

^define DISP_I 1 
sdefine DISP_J 0 
static PIXEL *_image_p; 
static PIXEL *_«htg_p; 
static int _last_level; 
static int _start_i, _start_j; 
static int _begin_i, _begin_;j, _end_i, _end_j; 
init_cont ours (image, whtg, xl, yl, x2, y2) 
PIXEL image t] [IMAGE_Xj ; 
PIXEL whtg ( ) [ IMAGE_X ] ; 
{ 

_image_p - fiimage { 0] [0] ; 
_whtg _p - fiwhtg[0JI0I; 
if (xl < 1) xl - 1; 
if (yl < 1) yl - 1; 

if (x2 > IMA3E_Y-1 ) x2 - IKAGE_Y-1; 
25 if (y2 > IMAGE_X-1 ) y2 = IMAGE_X-1; 

_begin_i = xl; _begin_j = yl; _end_i - x2; . _end_j = y2; * ' - 

_start_i » _begin_i; _start_j ■ _begin_j; . 
_last_level - -1; 

frajne_with_zeros (_image_p, xl-l,yl-l, x2, y2) ; 

next_contour (level, start_i, start_j, chain) 
int *start_i, *start_j; 
30 char far * chain; 

{ 

int c_iength; 

if (level !- _last_level) { 
_last_level - level; 

_start_i - _begin_i; _start_j = _begin_j; 

f ill_whtg <_image _p, _whtg_p, _start_i-l, _start_j-l, endi, _end_j, level) ; 
35 if (!find_init _point (6_start_i, s_start_j,_end_i, _end_j, _whtg_p, level) ) 

return (0) ; } 

c_ler.gth = search <_start_i, _start_j , _whtg_p, chain) ; 
*5tart_i - _start_i; 
*start_j - _start_j; 
return (c_length) ; 

} 

40 search (gi,gj, whtg, chain_buf) 

int gi,gj; PIXEL far *chain_buf; 
^ unsigned char far whtg [ ) ( IMAG£_X] ; 

PIXEL *p = 6whtg[0](0J + gj + (gi * IMAGE_X) , v; 
PIXEL *q - _image _p + gj + (gi * IMAGE X) ; 
PIXEL *p0 - p; ~ 
PIXEL far *pcb; 
45 i n t len - 0; 

Sdefine UNMASK (a, b) v s= (-(a)); *p - v; *pcb++ - (b) ; ++len- 
p0 - p; 

pcb - chain_buf; 
do { 

v - *p; 

if <v «*= 0) i printf ("\n OOPS!"); -pcb - 0 ; return (1); } 

50 
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if (len >« MAX_LENGTH) 

{ printf <"\n too long"); exit(l); } 
if (v & LEFT_BIT ) 

{ UNMASK (LEFT_BIT, LEF T_ARRGW ) ; 

— p; — gj; I 

else if (v i RIGfiT_BIT ) 

{ UNMASK (RIGHT_BIT, RIGHT_ARROK) ; 
+ +p; -c+gj; } 
else if ;v & UP_BIT ) 

{ UNMA S K ( UP_B I T , UP_AKROW ) ; 
20 P — IMAGE_X; — gi; } 

else if (v 6. DOWN_BIT ) 

{ UNMASK ( D OWN_B I T , DOWN_ARRO W ) ; 
p -r- IMAGE_X; ++gi; } 

) 

while ( p •* pO) ; 
»pcb++ - C; 
return (len) ; 

25 I 

plot_buf (circie_buf , buf_pomter, color, rnagni, smooth_d) 
int circle_buf [] [2] ; 

i 

int i; 

int k, l,il„j; 

float cividorl = (smooth_ d*2 . +1) / (float )magni; 
float dividor2 =» (smooth_d*2 . +1) / (float )magni; 
20 -f (bufjpointer < smooth_d ) { bufjpointer - 0 ; return (0) 

dline (0, 482, 0, 483, color) ; 
k - 1 = 0; 

for <i = -smooth_d / i <» smooth d ; ++i ) 
{ 

if < i < 0 ) j ~ buf_pointer+i ; else } » i; 
k +- circle_buf [ j] {0] ; 
1 +- circle buf t j] [11 ; 

35 ) 

1 « (int) ( (float) 1/dividorl) + DISPI ; 
k ~ (int) ( (float) k/dividor2) + DISP_J; 
M0VE_ABS (k, 1) ; 

for (il = 1 ; il <- buf oointer ; ++il) 
i ~" 
k =* 1 - 0; 

for (i=il-smooth d ; i <«• il+smooth d ; ++i ) 
40 { ~ ~ 

if < i<0 ) j - buf_pointer+i ; 

else if <i >-= buf_pointer ) j = i-buf_pointer ; 
else j - i; 

^ k +- circle_buf [ 3J [0] ; 1 += circle_buf [ j ] [ 1] ; 

1 - (int) ( (float) 1/dividorl) + DISP_I; 
k = (int) ( (float )k/dividor2) + DISP J? 
45 DRAW_ABS ( k , 1 , colo r ) ; 

} 

buf_pointer = 0,- 
return ( 1 ) ; 
) 

touch_frajne (i, j, chair._buf ) 
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PIXEL far *chain_buf; 

{ 

15 for ( ; *chain_buf ; ++chain_buf) 

{ 

3witch < *chain__buf > 
i 

case UP_AKR0W: — i ; break; 

case DOKN_ARROW: ++i ; break; 

case LEFT_AKROW: — j; break; 

case RIGHT_ARROW: ++j ; break; 

20 default : 

printf ("\n Illegal 2"); exit (0) ; 

} 



if 


(3 


<- 1) 






return (1) ; 


if 


(j 


>= IMAGE_X-2) 






return <2) ; 


if 


(i 


<= 1) 






return (3) ; 


if 


(i 


>= IMAGE_Y-2) 






return (4 ) ; 



25 

> 

return (0); 

} 

long 

meosure_chain_area <chain_buf > PIXEL *chain_buf; 

< 

long area - 0; 
int i - 1000; 
char c; 

for ( ; (c - *chain_buf++) ; ) 

\ 

switch (c) 
{ 

case UP_ARROW : — i; — area; break; 

case DOWN_ARROW: ++i; ++area; break; 

case LEFTVARROW : area — i; break; 

case RTGHT__ARROW: area +«■ i ; break; 

default. : 

printf <"\n Illegal 3"); exit(0); 

} 

40 } 

return (area) ; 

) 

draK_contour_nice (i, j, chainjbuf , magni, color) 
int I,}; PIXEL far *chain_buf; 

{ 

int xybuf [1024] [2] ; 
int min_i, min_j, max_i, max_i ; 
45 chain_to_r aster <i, j, chain_bu£, xybuf, &min_i, Smin_j, &max_i, £max_j) 

plot_buf (xybuf , strlen (chain_buf ) , color, magni. 3 ) ; 

} 

chain_to_raster (i, j , chainjbuf, xybuf , min_ip, min_jp, max_ip, max_jp) 
int i, j; PIXEL far *chain_buf; 
int xybuf t ] [2] ; 

int *min_ip, *min_jp, *max_ip, *max_Jp; 
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i 

PIXEL far *p; 
int ind; 

int min_i, min_j, max_i, max_j; 
min_i = INT_MAX; 
min_j - INT_MAX; 
max_i - INT_MIN; 
max_j - INT_MIN; 
ind - 0; 

for ( p = chain_buf; T p ; ++p) 
{ 

switch <*p) 
{ 

case UP_ARROW: — i ; break; 

case DOWN_ARROW: ++i ; breaks- 

case LEFT_ARROW: — j; break; 

case RIGHT_ARROW: +4 j ; break; 

default: 

printf <"\n Illegal 1") ; exit (C) ; 



xybuf find) [0] - ^; 
xybuf [ind] {13 = j; 
if (i < min_i) min_i = i; 
if <i > max_i) nax_i - i; 
if (j < min_j) nin_j • j; 
30 if (j > max_j) nax_j = j; 

++ind; 

\ 

*min_ip - min_i; *max_ip max_i+l; *min_jp - min_3; •max_jp = max__j+l; 
return (ind); 

} 

draw_contcur (i, j, chain_buf , magni, color) 

int i,j; PIXEL far *chain_buf; 

35 { 

PIXEL far *p - Schainjbuf [ 0] ; 

MOVE_ABS( (int) < (float )i * magni ), (int )(< float ) j * magni) ) ; 

for ( ; *p ; ++p) 

{ 

switch (*p) 
I 

case 'U': — i ; break; 

40 case ' D' : ++i ; break; 

case ' L* : — j; break; 

case ' R' : ++j ; break; 

default : 

printf ("\n Illegal"); exit(O); 

) 

DRAK_ABS ( (int) ( (float )i • magni) , (int )( (float ) j * magni) , color) ; 



) 

} 

f ill_whtg (im, whtg, s_i, s_j, max_i, max_j, level) 
PIXEL im [ } [ IMAGE_X ] ; 
PIXEL wht g { ) { IMAGE_X J ; 
int level , max_i , max j ; 

{ 

int i. j; 
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char mask; 

short pixl, pix2, pix3,pix4; 
for (i = s_i ; i < max_i ; 

for (j = s_j ; j < max_j ,- ++j> 

pixl - im{i-l] [ 3-11 ; 
pix2 « im(i-l] [ jj ; 
pix3 - imfij [ j] ; 
pix4 - ira[i] [j-lj ; 
mask - 0; 

if ( pixl >- level 4S pix2 < level ) mask I- UP_BIT ; 
if ( pix3 >- level && pix4 < level ) mask |» DOWN_BIT 
if ( pix4 >= level && pixl < level ) mask I- LEFT_BIT 
if < pix2 >- level && pix3 < level ) ma3k (- RIGHT BIT 
whtg [i] [ j] - mask ; 

} 

) 

f ind_init^pcint (px, py, max_i, max_j, whtg) 
int *px, *py; int max_i,max_j; 
*° PIXEL whtg [) [IMAGE_XJ ; 

< 

int s_r - *px, s_c = *py; 

for ( ; s_r < max_i ; ++s_r) 
i ■ - 

for (; s_c < max_j, ; ++s_c) 
\ 

30 if (whtg[s_r) (s_c) & ALL_BITS) 

{ *px - s_r ; 'py - s_c ; return<l);J 

> 

s_c = _begin_j; 
} 

return(O); 
} 

frame_with_zeros (image, xl, yl, x2, y2) 
35 PIXEL image [ ] [ IMAGE X] ; 

{ 

int i; 

for <i«=xl ; i < x2 ; ++i) 
i 

image U] [yl] = 0; 
image [i ] [y2-l ] » 0; 

> 

40 for (i o yl ; i < y2 ; ++i) 

< 

image £ x 1 ] [ i ] - 0 ; 
image 1x2-1] [i] = 0; 

> 
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*/ 

?ifndef ANSI 
^define signed 
*endif 

typedef unsigned char UBYTE; 
typedef signed char SBYTE; 
typedef unsigned short int UWORD; 
typedef signed short int SWORD; 
typedef unsigned long ULONG; 
typedef signed long SLONG; 
typedef double FLOAT; 
typedef UBYTE FUBYTE; 
typedef SBYTE FSBYTE; 
typedef UWORD FUWORD; 
typedef SWORD FSWORD; 
struct _UBY_b_point { UBYTE x; 
struct _UWO_b_point { 
struct _FLO_b__point { 
struct 
struct 



} ; 



FUBYTE y; 
UWORD x ; FUBYTE y ; } ; 
FLOAT x ; FUBYTE y ; } ; 
til_hbinfo { long hcentroid, height; ); 
til hfinfo { double hcentroid, height; 



^define min(a,b) ( (a )<(b)? (a ) : (b) ) 
#define max(a,b) ( (a )<(b)?(b) : (a ) ) 
^define FUBYTE_CONVERT( a ) (((double) a) / 255.0) 

static FUBYTE _UBY_b_ploop (UBYTE var, int n, struct _UBY_b_point *pts ) ; 
static FUBYTE _UBY bploop (UBYTE var, int n, struct _UBY_b_point *pts) 



{ 



register int i; 
FUBYTE _alpha; 
SLONG _tmp; 
SLONG _trep2; 
if (var < pts->x) 

„alpha = ((FUBYTE) 0); 
else if (var = pts->x) 

_alpha = pts->y; 
else { 

alpha = ((FUBYTE) 0); 
for (i=0; i < n - 1; i++, pts++) 

if (var > pts->x && var <= (pts+l)->x) ( 

_tmp2 = ((SLONG) (pts+l)->x) - ((SLONG) pts->x ) ; 
_tmp = ((SLONG) pts->y) * _tmp2 + 

(((SLONG) var) - ((SLONG) ptS->X)) * (((SLONG) (pts+l)-> 
_alpha = (FUBYTE) (_tmp / _tmp2); 
break; 
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) 

return _alpha; 

) 

static FUBYTE _UWO_b_ploop (UWORD var, int n, struct __uwo_b_point *pts); 
static FUBYTE _UWO_b_ploop (UWORD var, int n, struct _UWO_b_point *pts ) 

( 

register int i; 
FUBYTE _alpha; 
SLONG _tmp; 
SLONG _tmp2; 
if (var < pts->x) 

_alpha = ((FUBYTE) 0); 
else if (var — pts->x) 

_alpha = pts->y; 
else { 

_alpha = ((FUBYTE) 0); 
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for [i ■ 0; i < n - 1; pts++ ) 

10 if (var > pts->x && var <= (pts+l)->x) { 

tmp2 = ((SLONG) (pts+l)->x) - ( ( SLONG ) pts->x); 
trap = ((SLONG) pts->y) * _tmp2 + 

(((SLONG) var) - ((SLONG) pts->x)) * (((SLONG) (pts+l)-> 
_alpha = (FUBYTE) (_tmp / _tmp2); 
break ; 

) 

15 ) 

return _alpha; 

static FUBYTE _FLO_b_ploop (FLOAT var, int n, struct _FLO_b_point *pts ) ; 
static FUBYTE _FLO_b ploop (FLOAT var, int n, struct _FLO_b_point *pts) 
( 

register int i; 
FUBYTE _alpha; 
FLOAT _tmp; 
FLOAT _tmp2; 
if (var < pts->x) 

_alpha = ((FUBYTE) 0); 
else if (var =- pts->x) 

_alpha = pts->y; . ■ . 

else { 

25 _alpha = ((FUBYTE) 0); _ 

for (i=0;i<n-l; i++, pts++) 

if (var > pts->x && var <= (pts+l)->x) ( 
_tmp2 - (pts+l)->x - pts->x; 
trap = ((double) pts->y) * _tmp2 + 

(var - pts->x) * (((double) (pts+l)->y) - ((double) pts- 
__alpha - (FUBYTE) (_tmp / _trap2 ) ; 
20 break ; 

) 

) 

return _alpha; 

} 

FUBYTE _Ar e a_Ti n y_b_a 1 pha ; 

FUBYTE _Area_Small_b_alpha; 

FUBYTE _Ar ea_Med i um_b_a 1 pha ; 
35 FUBYTE _Area_Large_b_alpha ; 

FUBYTE _Area_Huge_b_alpha ; 

FUBYTE _AR_Square_b_alpha ; 

FUBYTE _AR_Bar_b_alpha; 

FUBYTE _P 2 A_Round_b_a 1 pha ; 

FUBYTE _P2A_Oval_b_alpha; 

FUBYTE _P2A_Odd_b_alpha; 
40 FUBYTE _Red_D_Well_b_alpha ; 

FUBYTE _IR_D_Poor_b_alpha; 

FUBYTE _IR_D_Low_b_alpha? 

FUBYTE IRDWe 1 l_b_a Ipha , 

FUBYTE _FIR_D_Poor_b_alpha; 

FUBYTE _FIR_D_Low_b_alpha; 

FUBYTE _FIR_D_Medium_b_alpha; 

FUBYTE _FIR_D_High_b_alpha; 
45 FUBYTE _FIR_D_VeryHigh_b_alpha; 

FUBYTE _RuleO00O_alpha; 

FUBYTE _RuleO050_alpha; 

FUBYTE _RuleO048_alpha; 

FUBYTE _Rule0047_alpha; 

FUBYTE _RuleO046_alpha; 

FUBYTE _Rule0044_alpha; 
50 FUBYTE _Rule004 2_alpha ; 

FUBYTE _Rule0041_alpha; 

FUBYTE _Rule0036 alpha; 

FUBYTE _Rule0039 alpha; 
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FUBYTE _Rule0037_alpha ; 
FUBYTE _Rule003 2_alpha ; 
FUBYTE _RuleO029_alpha; 
FUBYTE _Rule0034_alpha; 
FUBYTE _Rule0030_alpha; 
FUBYTE _Rule0027_alpha; 
FUBYTE _RuleO 0 2 8_a lpha ; 
FUBYTE _Rule002 2_alpha; 
FUBYTE _Rule0023_alpha; 
FUBYTE _Rule0017_alpha; 
FUBYTE _Rule0018_alpha; 
FUBYTE _Rule0015_alpha; 
FUBYTE _Rule0025_alpha; 
FUBYTE _Rule0016_alpha; 
FUBYTE _Rule0010_alpha; 
FUBYTE _Rule 001 l_a lpha; 
FUBYTE _Rule0013_alpha ; 
FUBYTE _Rule0007_alpha ; 
FUBYTE _Rule0008_alpha ; 
FUBYTE _Rule0005_alpha ; 
FUBYTE _Rule0004_alpha; 
FUBYTE _Rule0001_alpha; 
FUBYTE _Rule0003_alpha; 

static struct _UWO_b_point _Area_TinyJb_pts[ ] 
{ 0x00, 255 J , 
( 0x07 , 255 >, 
{ 0X011, 2 } 

); 

static • FUBYTE Area_Tiny_b (UWORD Area); 
static FUBYTE Area_Tiny_b (UWORD Area) 



{ 



_Area_Tiny_b_alpha = _UWO_b_ploop (Area, 3, _Area_Tiny_b_pts ) ; 
return _Area_Tiny_b_alpha ; 



) 

static struct 

{ 0x07, 1 T, 

{ 0x015, 255 } 

( 0x01b, 

{ 0x03a, 

( 0X065, 



UWObpoint _Area_Sroall_b_pts[ ] = { 



255 > , 
253 ), 
O ) 



static FUBYTE Area_Small_b 
static FUBYTE Area_Small_b 
{ 

Are a_Sma 1 1 b_a lpha 



( UWORD Area ) ; 
(UWORD Area) 



return _Area_Small_b_alpha ; 



UWO_b_ploop ( Area , 5 , _Area_Sma 1 l_b_pts ) ; 



static struct _UWO_b_point _Area_Medium_b_pts [ ] = ( 
{ 0x027, 0 } , 
{ 0X067, 255 ), 
{ 0x09c, 255 }, 
{ 0x0e6, 0 } 

}; 

static FUBYTE Area_Medium_b ( UWORD Area); 
static FUBYTE Area_Medium_b (UWORD Area) 
{ 

Are a Me d i um_b_a 1 pha 



return _Ar ea_Med i um_b_a 1 ph a ; 



UWO_b_ploop (Area, 4, _Area_Medium_b_pts) 



} 

static struct _UWO_b_point _Area_Large_b_pts[ J 
{ 0x078, O ) , 
( OXOfb, 253 > , 
{ 0x0129, 255 }, 
{ 0X0173, 5 ) 
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) ; 

static FUBYTE Area_Large_b (UWORD Area); 
static FUBYTE Area_Large_b (UWORD Area) 

_Area_Large_b_alpha = _UWO_b_ploop (Area, 4, _Area_Large_b_pts ) 
return _Area_Large_b_alpha ; 

static struct _UWO_b_point _Area_Huge_b_pts [ ] = { 
{ 0x0118, 0 } , 
{ 0x0190, 252 }, 
{ 0x01f4, 255 } 

static FUBYTE Area_Huge_b (UWORD Area); 
static FUBYTE Area_Huge_b (UWORD Area) 

_Area_Huge_b_alpha = Jjwo_b_ploop (Area, 3, _Area_Huge_b_pts ) ; 
return _Area_Huge_b_alpha ; 

static struct _FLO_b_point _AR_Square_b_pts[ ] = { 
( 0.000000, 0 }, 
{ 0.400000, 255 }, 
( 1.40000, 255 }, 
{ 2.20000, 0 ) 

); 

static FUBYTE AR_Square_b (FLOAT AR); 
static FUBYTE AR_Square_b (FLOAT AR) 

_AR_Square_b_alpha = _FLO_b_ploop (AR, 4, _AR_Square_b_pts ) ; ; 
return _AR_Square_b_alpha ; 

) 

static struct _FLO_b_point _AR_Bar_b_pts(] = ( 
{ 2.00000, 0 >, 
{ 2.40000, 255 ) , 
{ 3.00000, 255 ) 

); 

static FUBYTE ARBarb (FLOAT AR) ; 
Static FUBYTE AR_Bar_b (FLOAT AR) 
( 

ARBarb alpha = _FLO_b_ploop (AR, 3, _AR_Bar_b_pts ) ; 
return AR Bar b_alpha; 



) 

static struct 
static struct 
static struct 
static struct 
static struct 
static struct 
static struct 
static struct _ 

{ 0.0114155, 255 ), 

( 1.61644, 255 }, 

{ 2.33105, 0 } 

); 

Static FUBYTE P2A_Round_b (FLOAT P2A) ; 
static FUBYTE P2A_Round_b (FLOAT P2A) 



til_hbinfo _Out_stem_calyx_hbinf o = ( 24044L, 1717L 
"til_hbinfo _Out_Rot_hbinf o = ( 68699L, 1717L }; 
"til_hbinfo _Out_LRot_hbinf o = { 171749L, 1717L ) ; 
"til hbinfo _Out_Bruise hbinfo = { 274798L, 1717L }; 
"til_hbinfo _Out_PITJlbTnf o = { 326323L, 1717L ); 
~til_hbinfo _Out_PARLAT_hbinf o = { 377848L, 1717L ); 
"tiljibinfo _Out Nothing_hbinf o = { 417565L, 1717L ); 
~FL0_b_point _P2A_Round_b_pts[ ] = { 



50 



_P2A_Ro\ind_b_alpha = _FLO_b_ploOp (P2A, 3, _P2A_Round__b_ptS ) ; 
return _P2A_Round_b_alpha; 



) 

static struct _FL0_b_point 
( 1.68379, 0 ), 
{ 2.59132, 255 }, 
{ 4.00000, 255 }, 
( 5.62671, 0 } 



_P2A_Oval_b_pts[ ] = { 
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10 J; 

static FUBYTE P2A_Oval_b (FLOAT P2A) ; 
static FUBYTE P2A_Oval_b (FLOAT P2A) 
< 

_P2A_Oval_b_a lpha - _FLO_b_ploop (P2A, 4, _P2A_Oval_b_pts ) ; 
return _P2A_Oval_b_alpha ; 

} 

static struct _FLO_b_point _P2A_Odd_b_pts [ J = { 
( 3.68037, 1 >, 
{ 5.43721, 255 >, 
( 11.9863, 255 ) 

); 

Static FUBYTE P2A_Odd_b (FLOAT P2A) ; 
Static FUBYTE P2A_Odd_b (FLOAT P2A) 
{ 

20 _P2A_Odd_b_alpha = _FLO_b_pl oop (P2A, 3, _P2A_Odd_b_pts ) ; 

return _P2A_Odd_b_alpha ; 

) 

static struct _UBY_b_point _Red_D_Well_b_pts[ ] = { 
{ 28, 0 }, 
i 36, 255 ), 
{ 80, 255 ) 

25 static FUBYTE Red_D_Well_b ( UBYTE Red_D); 

static FUBYTE Red_D_Well_b (UBYTE Red_D) 
{ 

_Red_D_Well_b_alpha = _UBY_b_ploop (Red_D, 3, _Red_D_Well_b_pts ) ; 
return _Red_D_Well_b_alpha; 

> • 
static struct _UBY_b_po'int _IR_D_Poor_b_j)ts[ ] = { 
30 { 0, 255 } , 

( 2, 255 }, 
{ 8, 0 > 

}; 

static FUBYTE IR_D Poorb (UBYTE IR_D); 
static FUBYTE IR_ETPoor_b (UBYTE IR_D) 
{ 

_IR_D_Poor_b_alpha = _UBY_b_ploop ( IR_D , 3, _IR_D_Poor_b_pts ) ? 
return _IR_D_Poor_b_alpha; 
) 

static struct _UBY_b_point _IR_D_Low_b_pts[ ] = { 
(4,0), 
( 10, 255 }, 
{ 14, 255 ), 
{ 22, 0 > 

40 >'* 

static FUBYTE IR_D_Low_b (UBYTE IR_D) ; 
static FUBYTE IR_D_Low_b (UBYTE IR_D) 
{ 

_IR_DJLov_b_a lpha « _UBY_b_ploop (IR_D, 4, _IR_D_Low_b_pts ) ; 
return _IR_D_Low_b_alpha ; 

} 

static struct _UBY_b_point IR D Well b pts( ] = ( 
45 { 12, 0 }, ~ ~ " 

( 24, 255 }, 
{ 80, 255 } 

) ; 

Static FUBYTE IR_D_Well_b (UBYTE IR_D); 
static FUBYTE IR_D_Well_b (UBYTE IR_D) 
{ 

50 _IR_D_Well_b_alpha = _UBY_b_ploop (IR_D, 3, _IR_D_Wel l_b_pts ) ; 

return _IR_D_Well_b_alpha; 

) 

static struct _UBY_b_point _FlR_D_Poor_b_pts[ ] = { 
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{ 0, 255 }, 
< 2, 255 }, 
{ 10, O ) 

> ; 

static FUBYTE FIR_D_Poor_b (UBYTE FIR_D); 
static FUBYTE FIR_D_Poor_b (UBYTE FIR_D) 

{ 

_FIR_D_Poor_b_alpha = _UBY_b_ploop ( FIR_D , 3, _FIR_D_Poor_b_pts ) ; 
15 return _FIR_D_Poor_b_alpha ; 

} 

static struct _UBY_b_point _FIR_DJLow_b_pts [ ] = { 
( 4, 0 ), 
{ 10, 255 }, 
{ 18, 255 } , 
( 24, 0 } 

20 }; 

static FUBYTE FIR_D_Low_b (UBYTE FIR_D); 
Static FUBYTE FIR_D_LOW_b (UBYTE FIR_D) 

( ■ 

_FIR_D_LowjD_alpha = _UBY_b_ploop (FIR_D, 4, _FIR_DJLow_b_pts ) ; 
return _FIR_D_Low_b_alpha ; : 

} 

static struct _UBY_b_point _FIR_D_Medium_b_pts [] = { 

( 18, 0 }, " . . 

{ 26, 255 ), 
{ 34, 255 }, 

{ 44, 0 J ...... 

>; • ■ . ' ■■ . ■ • 

static FUBYTE FIR_D_Medium_b ( UBYTE FIR_D ) ; 
static FUBYTE FIR_D_Medium_b (UBYTE FIR_D) 
30 { 

_FIR_D_Medium_b_alpha = _UBY__b_ploop (FIR_D, 4, _FIR_D_Medium_b_pts ) ; 
return _FIR_D_Medium_b alpha; 

) 

static struct _UBY_b_point _FIR_D_High_b_pts [ ] = { 
( 32, 0 ), 
( 46, 255 }, 
35 ( 54, 255 ), 

{ 66, 0 } 

)i 

static FUBYTE FIR_D_High_b (UBYTE FIR_D) ; 
static FUBYTE FIR D High b (UBYTE FIR_D) 
{ 

_FIR_D_High_b_alpha = _UBY_b_ploop (FIR_D, 4, JFIR_D_HighJb_p ts > ? 
return FIR D High b alpha; 
40 j ~ 

static struct _UBY_b_point _FIR_D_VeryHigh_b_pts [ ] = { 
{ 50, 0 >, 
{ 60, 255 }, 
( 80, 255 } 

}; 

static FUBYTE FIR_D_VeryHigh_b (UBYTE FIR_D); 
45 static FUBYTE FIR_D_VeryHigh b (UBYTE FIR_D) 
( 

_F IR_D_VeryH igh_b_a 1 pha = _UBY_b_p 1 oop ( F IR_D r 3 , _FIR_D_Ver yHigh_b_pt s ) ; 
return _FlR_D_VeryHigh__b_alpha ; 

) 

static void B_Classifier (FLOAT AR, UWORD Area, UBYTE FIR_D, UBYTE FIR_V, UBYTE G 
static void B_Classifier (FLOAT AR, UWORD Area, UBYTE FIR D, UBYTE FIR V, UBYTE G 

50 { ' 
00 FUBYTE _alpha; 

FUBYTE _AR_is_Square ; 

FUBYTE _AR_is_Bar; 

FUBYTE _Area_is_Tiny? 
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FUBYTE _Area_is_Small; 
10 FUBYTE _Area_is_Medium; 

FUBYTE _Area_is_Large; 
FUBYTE _Area_is_Huge ; 
FUBYTE _FIR_D_is_Poor ; 
FUBYTE FIRDisLow; 
FUBYTE _FIR_D_is_Medium; 
FUBYTE _FIR_D_is_High; 
15 FUBYTE _FIR_D^is_VeryHigh; 

FUBYTE _IR_D_Ts_Lqw ; 
FUBYTE _IR_D^is_Well; 
FUBYTE _P2A_Ts_Round; 
FUBYTE _P2A_is_Odd; 
FUBYTE _Red_D_is_Well ; 
struct _til_hbinfo _Out_terop; 
memset ( &_Out_terap , 0, sizeof (_0ut_terop) ) ; 
_AR_is_Square = AR_Square_b (AR); 
_AR_is_^Bar = AR_Bar_b (AR) ; 
__Area_Ts_Tiny = Area_Tiny_b (Area); 
_Area_is_Small = Area_Small_b (Area); 
_Area_is_Mediuin = Area_Medium_b (Area); 
_Area_is_Large = Area_Large_b (Area); 
_Area_is_Huge = Area_Huge_b (Area); 
25 _FIR_D_is_Poor = FIR_D_Poor_b (FIR_D); 

_FIR_D_is_Low = FIR_D_Low_b ( FIR_D ) ? 
_FIR_D_is_Medium = FIR_D Medium_b (FIR_D); 
_FIR_D_is_High = FIR_D_High_b (FIR_D); 
_FIR_D is_VeryHigh = FIR_D_VeryHigh_b (FIR_D); 

_IR_D_Ts_Low = IR_D_Low_b (IR D); ■' * * 

_IR_D is_Well « IR_D_Well_b (IR_D); 
30 _P2A_Ts_Round = P2A_Round_b (P2A); 

_P2A_is Odd = P2A_0dd_b (P2A); 
_Red_D_Ts_Well = Red_D_Well_b (Red_D) ; 

alpha = min(_Area_is_Tiny , _FIR_D_is_VeryHigh) ; 
Tf (_alpha ! = ((FUBYTE) 0)) { 
/* Out - PIT */ 

_Out_temp . hcentroid += _alpha * _Out_PIT hbinf o . hcentroid ; 
35 _Out_temp. height += _alpha * _Out_PIT_hbInf o . height ; 

) 

_RuleOO0O_alpha = alpha; 

alpha = min(min(mTn(_Area_is_Sraall , _FIR_D_is_Low) , _AR_is_Bar ) , IR D is We 
Tf (_alpha != ((FUBYTE) 0) ) { ~ _ 

_Out_temp. hcentroid +- _alpha * _Out_Stem_Calyx_hbinf o. hcentroid ; 

_Out_temp. height += _alpha * _Out_Stem_calyx_hbinfo. height ; 

40 ) 

_Rule0050_alpha = alpha; 

alpha - min(min(mTn(min(_Area_is_Small, _AR_is_Square ) , FIR D is Poor), P2 
Tf (_alpha != ((FUBYTE) 0)) { ~* ~ 

_Out_temp. hcentroid _alpha * _Out_PARLATJibinfo. hcentroid; 
_Out_temp. height += _alpha * _Out_PARLAT_hbinfo. height; 

) 

_Rule0048_alpha = ^alpha; 

alpha = min ( min (mTn( rain ( min ( _Area_is_Huge , _AR_is_Square ) , FIR D is Poor), 
Tf (_alpha ! - ((FUBYTE) 0)) { ~ ~ 

_Out_temp. hcentroid += _alpha * _OutjBruise_hbinf o. hcentroid ; 

_0ut_temp. height += _alpha * _Out_Bruise_hbinfo. height; 

) 

_Rule0047alpha = alpha; 
alpha = min(min(mTn(rain(_Area_is_Large, _FIR_D_is Poor), AR is Square), IR 
50 Tf (_alpha != ((FUBYTE) 0)) { - - - 

_Out_temp . hcentroid +- _alpha * _Out_Bruise hbinf o. hcentroid ; 
_Out_temp. height += _alpha * _0ut_Bruise hbTnfo .height ; 

} 

_Rule0046_alpha = _alpha; 
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alpha = min(min(nin(_Area_is_Huge, _FIR_p_is_Poor ) , _AR_is Square), P2A is 
If (_alpha != ( ( FUBYTE ) 0)) { ~~ ~ - _ _ 

_Out_temp. hcentroid += _alpha * _Out_Bruise^_hbinf o . hcentroid ; 
10 _Out_temp. height += _alpha * _Out_Bruise_hbTnfo. height ; 

) 

_Rule004 4_alpha - alpha; 

alpha = min(min(mTn(min(_Area_is_Mediu2n, _FIR_D_is_Low) , IR D is Well), P2A 
If (_alpha != ( (FUBYTE ) 0)) { ~ 
_Out_temp. hcentroid += _alpha * _Out_Rot hbinf o .hcentroid ; 
_Out_temp. height += _alpha * _Out_Rot_hbInf o . height ; 

} 

_Rule004 2_alpha - alpha; 

alpha o min(min(mTn(min(_Area_is_Small , _FIR_D_is_Poor) , IR D is Well), P2 
If (_alpha != ((FUBYTE) 0)) { ~ ~ ~ 

__Out_temp. hcentroid += _alpha * _Out_Bruise hbinf o . hcentroid ; 
_0ut_temp. height += _alpha * _Out_Bruise hblnfo. height; 

> 

_Rule0041_alpha = ^_alpha; 

alpha - min(min(mIn(min(_Area_is_Medium, _AR_is_Square) , FIR D is Poor), I 
If (_alpha 1= ( ( FUBYTE) 0)) { ~ - 

_0ut_temp. hcentroid += _alpha * _Out_Bruise hbinf o. hcentroid; 
_0ut_temp. height += _alpha * _Out_Bruise_hbInf o . height r 

} 

25 _Rule0036_alpha = _alpha; 

alpha = min(_Area_is_Tiny , _FIR_D_is_Medium) ; . ' 

If (_alpha 1 = ((FUBYTE) 0)) { 

_Out_temp. hcentroid += _alpha * _Out_PIT hbinf o. hcentroid; . 
_0ut_terap. height* += _alpha * _Out_PIT_hbInf o . height ; ' 1 : ' 
) " ~ . . _ . . 

_Rule0039_alpha = alpha; 
30 _alpha = min(min(mIn(min<_Area_is_Medium, _AR_is_Square) , FIR d is Low), IR 
if (_alpha != ((FUBYTE) 0)) < _ 
_Out_temp. hcentroid _alpha * _Out_Bruise hbinf o. hcentroid; 
_Out_temp. height += _alpha * _Out_Bruise_hbInf o .height ; 

> 

_Rule0037_alpha = alpha; 
alpha = min(min(mIn(Tnin(_Area_is_Huge, _AR_is_Square) , FIR D is Poor), IR 
35 If (_alpha != ((FUBYTE) 0)) { ~ ~~ ■ ~~ 

_out_temp. hcentroid += _alpha * _Out_Bruise hbinf o . hcentroid ; 
_Out_temp. height += _alpha * _Out_Bruise_hbInf o. height; 

) 

__Rule0032_alpha = alpha; 

alpha = min(roin(mIn(min(_Area_is_Large, AR is Square), FIR D is Low), IR 
If (_alpha I « ((FUBYTE) 0)){ ~ ~~ ~ _ 

40 /* Out » Bruise */ 

_Out_temp . hcentroid += _alpha * _out_Bruise_hbinfo.hcentroid; 
_Out_temp. height += _alpha * _0ut_Bruise_hbinfo. height; 

} 

_Rule0029_alpha = alphas- 
alpha = min(min(mIn(_Area_is_Huge, _AR_is_Square ) , FIR D is Low), IR D is 

If (alpha != ((FUBYTE) 0 ) ) { ~ ~ - ~ 

/* Out = Bruise */ 

_0ut_temp. hcentroid += _alpha * _Out_Bruise hbinf o . hcentroid ; 
_0ut_temp. height += alpha * Out Bruise hbinf o. height; 
) ~~ " 

_RuleO0 34_alpha = alphas- 
alpha^ min(iain(mIn(min(_Area_is_Large, _AR_is_Square ) , FIR D is Poor), IR 
If (_alpha != ((FUBYTE) 0)) { ~ ~ ~ 

/* Out = Bruise */ 
_Out_temp. hcentroid += _alpha * _Out_Bruise hbinf o. hcentroid; 
_Out_terap. height += _alpha * _Out_Bruise_hbInf o. heigh t ; 

_Rule00 30_alpha = _alpha; 

_alpha = min(rain(_Area_is_Medium, _FIR_D_is_High ) , ((FUBYTE) 255) - _AR_is Ba 
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if (_alpha »= ( ( FUBYTE ) 0)) ( 

_Out_temp. hcentroid += alpha * _Out_Rot hbinf o . hcentroid ; 
_Out_temp. height += _alpha * _Out_Rot_hbInf o . height ; 

10 ) 

_Rule00 27_alpha = _alpha; 

alpha = min(_Area_is_Medium, _FIR_D_is_ Very High) ; 
If (_alpha »= ((FUBYTE) 0)) { 

_0ut_temp. hcentroid += _alpha * _0ut_Rot hbinf o . hcentroid ; 
_0ut_teinp. height += _alpha * _Out_Rot_hbInf o .height ; 

15 _Rule0028_alpha = _alpha; 

alpha = min (_Area_is_Small , _FIR_D_is_Poor ) ; 
If (_alpha J= ( (FUBYTE) 0)) { 
/* Out = Nothing */ 

_Out_temp. hcentroid += _alpha * _Out_Nothing hbinf o . hcentroid; 
- _out_temp . height += _alpha * _0u t_Nothing_hb!nf o. heigh t; 

_Rule0022_alpha = alpha; 

alpha = min(min(mIn(_Area_is_Small , _FIR D is Low), IR D is Well), P2A is 
If (_alpha 1= ((FUBYTE) 0)) { ~ ~ ~" ~~ _ _ _ 

_Out_temp. hcentroid +- _alpha * _0ut_PIT hbinf o. hcentroid ; 
_Out_temp. height += _alpha * _Out_PIT_hbInf o. heigh t ; 

_Rule0023_alpha - _alpha; . . 

alpha = min(_Area_is_Tiny , _FIR_D_is_Poor ) ; 
If (_alpha i= ((FUBYTE) 0)) ( 

_0ut_temp. hcentroid += _alpha * _Out_Nothing hbinf o. hcentroid ; 
_Out_temp. height += _alpha * _Out_Nothing_hbInfo. height; . 

_Rule0017_alpha = alpha; 
alpha - min (min (min (_Area_is_Tiny , _FIR D is Low), IR D is Well), P2A is R 

M if (_alpha J= ((FUBYTE) 0)){ ~ ~ ~ _ - - 

_Out_temp.hcent.ro id +- alpha * _out__PIT hbinf o. hcentroid ; 
_put_temp. height. += _alpha * _Out_PIT_hbInf o .height ; 

_Rule0018_alpha = _alpha; 

alpha = min(min(_Area_is_Large, _FIR_D is Medium), ((FUBYTE) 255) - P2A is 
if (_alpha != ((FUBYTE) 0)) { " ~~ . _ _ _ 

__Out_temp. hcentroid += _alpha * _Out_LRot hbinf o. hcentroid ; 
_Out_temp. height += _alpha * _Out_LRot_hbInf o . height ; 

_Rule0015_alpha = _alpha; 

_alpha = min(min(_Area_is_Tiny, FIR D is Low), ((FUBYTE) 255) - P2A is Roun 
if (_alpha != ((FUBYTE) 0)) { ~ _ _ _ 

40 _Out_temp. hcentroid += _alpha * _Out_Nothing hbinf o .hcentroid; 

_Out_temp. height += _alpha * _Out_Nothing_hbInfo .height ; 

_Rule0025_alpha — _alpha; 

_alpha = mih(min(_Area_is_Huge, _FIR D is Medium), ((FUBYTE) 255) - P2A is O 
if (_alpha != ( (FUBYTE) 0)) { ~ - _ _ 

_Out_temp. hcentroid += _alpha * _Out_LRot_hbinf o . hcentroid ; 
45 _Out_temp. height += _alpha * _Out_LRot_hbinf o . height ; 

_Rule0016_alpha = alpha; 

_alpha = min(min(mIn(_Area_is_Large, FIR D is High), ((FUBYTE) 255) - P2A i 
if (_alpha • = ((FUBYTE) 0)) { ~ ~ - - 

_Out_temp . hcentroid += _alpha * _0ut_LRot hbinf o . hcentroid ; 

_Out temp. height += alpha * Out LRot hbinf o . height ; 
50 } , " - - - 

_Rule0010_alpha = _alpha; 

alpha = min(min( Area is Large, FIR D is VeryHigh), ((FUBYTE) 255) - P2A i 
If (alpha != ((FUBYTEj oT) < ~ ~ ~ 

_Out_temp. hcentroid += _alpha * _Out_LRot_hbinfo .hcentroid ; 

_Out_temp. height += _alpha * _Out_LRot_hbinf o. height ; 
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_Rule0011_alpha = alpha ; 

alpha = min(min(mTn(_Area_is_Huge, _FIR_D_is_High) , ( ( FUBYTE ) 255) - _P2A_is 
Tf (_alpha != ((FUBYTE) 0)) { 

Out temp.hcentroid += _alpha * _Out_LRot hbinfo. hcentroid; 
~Out_temp. height += _alpha * _Out_LRot_hbTnf o. heigh t; 

> 

15 _Rule0013_alpha - _alpha; 

alpha = min(_Area_is_Tiny , _FIR_D_is_High) ; 
If (_alpha »= ((FUBYTE) 0)) { 

Out temp.hcentroid += _alpha * _Out_PIT hbinfo. hcentroid ; 
30ut~temp. height += _alpha * _Out_PIT_hbTnfo . height ; 

> 

__Rule0007_alpha = _alpha; 
20 alpha - min(min(_Area_is_Small , _FIR_D_is_High ) , ((FUBYTE) 255) - _AR_is_Bar 

If (_alpha 1= ((FUBYTE) 0)) { 

_Out_temp. hcentroid += _alpha * _Out_PIT hbinf o. hcentroid; 

_Out_temp. height += _alpha * _Out_PIT_hbTnfo . height ; 

> • 
_Rule0008_alpha = alphas- 
alpha = min(min(mTn(_Area_is_Huge, _FIR_D_is_ Very High) , ((FUBYTE) 255) - _P2 
25 Tf (_alpha 1= ((FUBYTE) 0)) { 

_Out_temp. hcentroid += _alpha * _Out_LRot^hbinf o. hcentroid ; 
_0ut_temp. height += _alpha * _Out_LRot_hbTnf o. height ; 

> 

_Rule0005_alpha- = alphas- 
alpha = min(min(mTn(_Area_is_Mediura, _AR_is_Square ) , _FIR_D_is_Medium) , ( (FU - 
Tf (_alpha ! = ((FUBYTE) 0)) { . X 

_Out_temp. hcentroid += _alpha * _Out_LRot^hbinf o . hcentroid; 
_0ut_temp. height += _alpha * _Out_LRot_hbTnfo. height; 
> 

_Rule0004_alpha = _alpha; 

alpha = min(_Area_is_Small, _FIR_D_is_VeryHigh) ; 
Tf (_alpha != ((FUBYTE) 0)) { 

_Out__temp. hcentroid += _alpha * _Out_PIT hbinf o. hcentroid ; 
Out temp. height += alpha * _Out_PIT_hbTnfo .height ; 
35 ) ' ~ ~ 

_Rule0001_alpha = alphas- 
alpha = min(min(mTn(min(_Area_is_Small , _FIR_D_is_Mediuin ) , ((FUBYTE) 255) - 
Tf (_alpha != ((FUBYTE) 0)) { 

_Out_temp. hcentroid += _alpha * _Out_PIT hbinfo. hcentroid; 
_Out__temp. height +» _alpha * _Out_PlT_hbTnf o .height ; 

) 

40 Rule0003_alpha = _alpha; 

Tf (_Out_temp. height 1 = 0L) 

*Out = ( ( UBYTE) (_Out_temp. hcentroid / _Out_temp. height) ) ; 

) 

void Blemish_Class (FLOAT AR , UWORD Area, UBYTE FIR_D, UBYTE FIR_V, UBYTE Green_D 
{ 

B_Classifier (AR r Area, FIR_D, FIR_V, Green_D, Green_V, IR_D, IR_V, P2A, Red_ 
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/* 



File name: appl4.c 



ID: 014 



double *, int); 
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V 

int test_f l_decisions (unsigned char *, 
^include <fcntl.h> 
Jj include <raalloc.h> 
^include <stdio.h> 
# include <limits.h> 
# include <conio.h> 
i include <string.h> 
# include <memory.h> 
§ include <math.h> 
$ include "adapter. h" 
^define D_ST_CA 12 
#define D_ROT 4 5 

§ define D_MOTH 65 
^define d_lrot 101 
^define D_RUSSET 131 
define D_BRUISE 161 
#define D_PIT 191 
^define D_PARLAT 220 
#define D_NOTHING 241 
#def ine BLEMISH_KINDS_N 9 

int combine_all_masks( PIXEL [FR_Y_SIZE) [FR_X_SIZE) , 

PIXEL [ FR_Y_SIZE] [ FR • 

cancel_color(PIXEL[FR_Y_SIZE] [FR__X_SIZEJ /int ) ; 
combinejniasks( PIXEL [FR_Y_SIZE] [FR_X_SIZE] , 

PIXEL * ) ; 

do_3df ile(char *, struct boundary_data *, struct boundary_data *, 
struct boundary_data * , PIXEL [FR_Y_SIZE] [FR_X_SIZE] , 
PIXEL [ FR_Y_SIZE ] [ FR_X_SIZE] , PIXEL [ FR_Y_SIZE ) [ FR_X_SIZE ] , 
PIXEL [FR_Y_SIZE][FR_X_SIZE] , double *); 
smooth_bnd( struct boundary_data *); 

make_draw_f ile(char *, struct boundary_data *, struct boundary_data *, 
struct boundary_data * , PIXEL [ FR_Y_SIZE ] [ FR_X_SIZE ] , 

PIXEL [FR_Y_SIZE] [FR_X_SIZE] ,PIXE 

double * ) ; 

draw_all (struct boundary_data *, struct boundary_data * r 

struct boundary_data * , PIXEL [FR_X_SIZE] [ FR_Y_SIZE] , 
PIXEL ( FR_X_S I ZE ) [ FR_Y_S I ZE ] , 

PIXEL [FR_X_SIZEJ [FR_Y_SIZE] , int *); 
compute_line_all(int *, int *, int * , int * , int * , int *,int *); 
compute_line_area( int *, int *, int *,int *,int *); 
f ind_3d_location( int, int, int, float *, float *, float *, 

struct boundary_data *, struct boundary_data *, 
struct boundary data * , int * ) ; 
calc_Je>lemish_area( int ,int , int ,Xnt , int , 

struct boundary_data *, struct boundary_data *, 
struct boundary_data * , int *); 
make_line_drawing( int *,int *,int *,int *,int *, PIXEL [FR X SIZE], 

PIXEL [FR_X_SIZE] , PIXEL [ FR_X_SIZE ), double ) ; 
imagin_stera_calix_coord( struct boundary_data *, struct boundary_data *, 

struct boundary_data *, float *, float *,int *); 
validate_in_pic( int * , int * , int * , int *, 
struct boundary_data *,int); 

calc_area_ratio( int , int * , int * , int , struct boundary_data *, 

struct boundary __data *, struct boundary data *, 
int * , int ) ; ~ 
void insert_img( struct spot *, double, double, double); 

double angle_between_n( double, double, double, double, double, double , double *); 
^define CHAIN_SIZE 2048 
#define CAM 1 



int 
int 

int 



int 
int 



double 



double 
double 
int 



double 



int 
void 



void 



double 
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? define DELTA A 
10 sdefine MIN_DIST 0.7 

± define MIN_ANGLE 14 0 
#define MIN_IR 160 
^define MIN_FIR 170 
^define MIN_ST_AREA 19 
static int _cam_nuraber ; 
extern int stemindex, calyx_index; 
15 extern int debug_flag; 

extern struct prog_settings prog_consts; 
extern struct single_view_inf o view_inf o[N_CAMERAS] ; 
ma 1 v_fill_con tour (contour , color, min_i, max_i , min j, max j) 
int min_i, max_i, min_ j , max_ j ; 
PIXEL contour [ FR_Y_SI ZE ] [FR_X_SIZE] ; 
int color; 

( 

int i , j ; 

PIXEL string [ FR_X_SIZE] ; 

for (i = min_i-l; i <= raax_i+l; i++) 
i 

for (j = 0; j < FR_X_SIZE; j++) 

stringfj] = 0; 
for { j = min_j-l ; 

contour[i] [ j] != 85 && j <= max_j+l ; ++j) 

if ( (contour[i][ j] ==76) || (contour[i] [ j] 68) j| (contour[i][ 

contour[i] [ j J = color; 
) ' .».-••':;: • 

if { j <= max_ j ) 

{ ' 
30 contour [ i ][ j ] = color; 

string_color (i,j, max_j, contour, string, color); 

for (j = 0; j < FR_X_SIZE; j++) 
{ 

if ( stringfj] != 0 ) 

contour[i] [ j] = string[j]; 

fill_stnngj3lack( contour, color, min i, max i, min j, max j); 
return(l); "~ — — 

) 

string^colorfio, jo,max_j, contour, filled, color) 
Tnt iO, jO, max_j, color; 
PIXEL contour [FR_Y_S I ZE] [FR_X_SIZE] ; 
PIXEL filled[FR X SIZE] ; 
{ 

int j, jbeg, jl? 
j= jO; 
jbeg = j; 

while ( (contour[i0][ j] != 68) && ( j <= max_ j ) ) 

45 if (contour[i0] [ j] = 85) jbeg = j; 

if ( (contour[i0][ j] =-76) || ( contourf iO ] [ j ] ==68) II (contourfi 

contour [i0][jj = color; 
j++; 
} 

if ( j > max__ j ) return ( -1 ) ; 
for (jl = jbeg; jl <= j ; 
qq filled[jl] = color; 

jbeg = j; 

while { (contour[i0][ j] != 85) && ( j <= max_j)) 
if (( contour [i0][j ] == 68)) 
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for (31 = }beg; jl < j+1 ; jl++) 
filled[jl] = color; 

> 

if(( (contour [ iO] [ j] = 76) jj ( contour [ i O ][ j] == 82))) 
{ 

filled[j] = color; 
jbeg = j; 

) 
) 

if (j > max_j) return (0); 
contour [ iO] ( j ) = color; 

string_color (iO,j, max_ j , contour, filled, color); 
return ( 2 ) ; 

20 > 

fill_string black ( filled, color, mini, max_i , min_j, max_ j ) 
int man i, max_i , min_ j , max_ j , color; 
PIXEL f!lled[FR_Y_SIZE] [FR_X_SIZEJ ; 

( 

int i,j ; 

int color 3 = 3*color; 
int color 2 = 2*color; 
25 for ( i = max i-1; i > min_i; i — ) 

{ 

for ( j = max_j-l; j > min_j; j — ) 

I 

if ( filled [i}£j] == 0) 

{ . - - 

if ((( filled[i-l)[ j+l] + filled[i)[ j+l] + f illed[ i+l ] [ j+l] ) 
30 " color3) && 

((filled[i-l][j] +filled[i+l][j)) 
co lor- 2 ) ) 
f illed[i)[ j] = (PIXEL) color; 
) 

) 

J 

return ( 1 ) ; 

} 

draw__contour_mem(mat , i, j, chain buf, color) 
PIXEL mat [ ] [ FR_X_SIZE ) ; 
int i,j; char far *chain_buf; 

( 

char *p = &chain_buf [0] ; 
for ( ; *p ; ++p) 
40 i 

switch ( *p) 
{ 

case •u 1 : — i ; break; 

case 'D»: ++i ; break ; 

case *L* : — j; break; 

case 'R* : ++j ; break; 

default: 

printf (*'\n Illegal"); exit(0); 
> 

mat[i)[j] = *p; 

) 

} 

print_contour_data ( spots , index, id) 
struct spot spots [ ] ; 

50 ( 

double al, bl; 

printf ("\n contour ID %3d, New ID: %3d» , / 

id, spots [index] . flag3); 
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printf ("\ngreen %4d %4d 

spotsf index] .green_cgl, spots [ index] .g_ar_mean) ; 
printf ( M \nred %4d %4d ", 

spots [ index J . red_cgl , spots [ index] . r_ar_mean) ; 
printf ("\nir %4d %4d ", 

spots [ index] . ir_cgl , spots [ index] . i_ar_mean) ; 
printf ( "\ngrid %4d %4d " , 

spots [ index ] . gr id_cgl , spots [ index ] . grid_ar_mean ) ; 



printf ( "\n\t\tarea per x y p2a 
al = ( spots [ index] .al > spots [ index] .bl) 



dl/d2 ar occ_ar s_spot fl" ); 
? spots [ index] .al : spots [ index] . b 



bl = ( spots [ index] .al < spots [ index] . bl ) ? spots [ index] .al : spots [ index] . b 



printf ( "\n\t\t %4d %4d %4d %4d 
spots [ index ] . area , 
spots [ index ] . per , 
spots [ index ] .al, 
spots [ index j.bl, 
spots [ index ] . p 2a , 
0.0, 

spots [ index ] . ar , 

(double) (spots[ index] . area )/{ double ) (al*bl) , 
spots [ index ] . f lagl , 
spots [ index] . f lag_g ) ; 



%5.2f %5.2f %5.2f %5.2f %3d %3d\n" , 



) 

test_overlap( spoti , spot2 ) 
( 

double f; 

if ( (spotl->min_i <= spot2->rain_ 
(spotl->min_j <= spot2->min j~ 

{ 

f = ( double )spotl->area / (double ) spot 2->area; 
if (f < 1.0) f = l./f-; 
if ( f > 2.0) return ( 3 ) ; 
else return(l); 

I 

return ( 0 ) ; 

) 

display_all_selected( spots, spt_index, cam_nuinber) 
struct spot spots[]; 

( 

int i; 

printf ( "\n Findings : " ) ; 
for (i = 0 ; i < spt index ; ++i) 
I 

if (spots[i] . f lag2 = 0) continue; 
if (debug_flag) 

draw__contour_file(&spots[i] , 
printf (" %2d)",i); 

svitch ( spots [ i ] . f lag 2 ) 
( 



struct spot *spotl , *spot2 ; 



&& spotl->max_i >= spot2->max_i ) && 
■ spotl->max_j >= spot2->max_ j ) ) 



0 , cam_number , 3 , 0 , 0 ) ; 



case 


D 


ST CA : 


printf ( » 


ST CA" ) ; 


break; 


case 


D" 


ROT : 


printf ( » 
printf (" 


ROT" ) ; 
MOTH") ; 


break; 


case 


d" 


"MOTH : 


break; 


case 


d" 


~LROT : 


printf (« 


LROT" ) ; 


break ; 


case 


d" 


"RUSSET : 


printf (" 


RUSSET" ) ; 


break ; 


case 


d" 


"BRUISE : 


printf ( " 


BRUISE" ) ; 


break; 


case 


d" 


"PIT : 


printf ( " 


PIT") ; 


break ; 


case 


d" 


"PARLAT : 


printf (" 


PARLAT" ) ; 


break; 


case 


d" 


"NOTHING : 


printf ( " 


NOTHING" ) ; 


break; 



50 



choose_defects_by_se verity ( spots , spt_index , 
struct spot spots[]; 



cam_n umber ) 
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int i, j; 

for (i ■ 0 ; i < spt_index ; ++i) 
{ 

if (spots[i] . cam_number i= cam_number ) continue; 
if ( spots [i J .flagl == 0) continue; 
if (spotsfi] .f lag2 == 0) continue; 

if (1 || spots [ i ] .flag2 == D_JROT || spots [ i ). flag2 = DLROT |j 
spots [i] .flag 2 == D PIT) 
15 < 

cancel_occluding_contours_type( spots, i, DJROT, D_LROT , D_PIT, D_S 

} 

) 

$ifdef AAA 

for (i = 0 ; i < spt_index ; ++i) 
{ 

if ( spots ( i ). flagl == 0) continue; 
if ( spots [ i ] . f lag2 == 0) continue; 
if ( spots [i].flag2 == D_BRUISE) 
{ 

cancel_occluding_contours_type( spots, i, D_BRUISE, 0, 0, 0 f spt_in 

) 

} 

-jendif 

for (i = 0 ; i < spt_index ; ++i ) 
( 

if (spots [i] .flagl ~ 0) continue; 
if ( spots [ ij . f lag2 = 0) continue; 

cancel_remained( spots, i, 0, 0, 0, o, sptindex); 

> 

display_all_selected( spots , spt__index, cam_number); 

30 ) 

cancel_remained( spots, i, tl, t2 , t3 , t4 , spt_index ) 
struct spot spots [] ; 

( 

int j , ovlp ; 
return ( 1 ) ; 

if (spots[i]. flagl == 0 | | spots[ i] . flagl >= 100) return(l); 
35 for (j - 0 ; j < i ; ++j) 

if ( spots [ j ] . f lag2 = 0) continue; 

if ( spots [ j 3 . f lagl = 0 || spots[ j ]. flagl >= 100) continue; 
ovlp =» test_overlap( &spots[ j } , &spots[i]); 
if (ovlp) { 

spots[ j ] . f lag2 = 0 ; 

> 

cancel_6ccluding_contours_type( spots, i, tl , t2, t3 , t4 , spt_index) 
struct spot spots [ ] ; 

{ 

int j , ovlp; 

if (spots[i] .flagl ===== 0 J | spots [ i ]. flagl >= 100) return(l); 
45 for (j = 0 ; j < i ; ++j) 

{ 

if (spots ( j ] .flagl == 0 | | spots [ j ]. flagl >= 100) continue; 

if ( spots [ j ] . f lag2 == 0) continue; 

ovlp = test_overlap( &spots[ j ] , &spots[i]); 

if (ovlp = 3) continue; 

if (ovlp) { 

if ( spots [ i 3 . mate > spots [ j ]. mate ) { 
50 spots [ j] .flag2 = 0 ; 

spots £ j j .f lag 3 = i; 

. ) 

else { 
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spots [ i } . f lag 2 = 0 ; 
spots[i ] .flag3 = j; 
break; 

> 

} 

) 

) 

group_occluding ( spots , spt_index ) 

struct spot spots []; 
{ 

int i, j; 

for (i = 0 ; i < spt_index ; ++i) 
{ 

if ( spots [ i] .f lagl == 0) continue; 
if ( spots [ i] . f lag 2 == 0) continue ; 
20 for (j = 0 ; j < spt_index ; 

{ 

if ( spots [ j ] . f lag2 — 0) continue ; 
if (j == i) continue; 

if (test_overlap(&spots [ i] , &spots[j))) 

spots [ j ] . f lag2 = 0; 

) 

- > ' 

draw_contour_f ile (spot , id, color, cam_number , magni , off_x, off_y) 
struct spot *spot; 

{ 

int j, ret, per; * • \ ; 

char c_name[80]; " " " 

char chain [ CHAIN_SIZE ] ; 
30 sprintf (c_name, "%s%ld_%ld.cnt" , TMP_DEVICE, cam_number f id); 

ret = undump_spots ( c_naroe , chain, sizeof (chain ) , &per); 
if (ret « FAILURE) { 

printf ( "\nContour file %s not found" , c_name); return(l); 

) 

draw_contour_nice(spot->start_i+of f_y, spot->start_ j+of f x, 

chain, magni, color ); 

> 

undumpspots ( name , buf, size, count) unsigned int size; char *buf; 

int *count; char *naroe; 
{ 

int in_file; 
unsigned int br; 

in_file = open (name, ( 0_RDONLY j C_BINARY) , 0 ); 

if (in_file -1) return ( FAILURE ) ; 
40 br « read(in_f ile, buf, size); 

if (br 1= size) ( close ( in^f ile) ; return ( FAILURE ) ; ) 

br « read ( in_f ile, count, sizeof (Tnt) ) ; 

if (br != sizeof (int)) { close ( in_f ile ) ; return ( FAILURE ) ; ) 

close ( in_f ile ) ; 
return ( SUCCESS ) ; 

) 

45 decide about_con tour ( spots , index, draw_flag, cam_number) 

struct spot spots[]; int index; 

{ 

double AR, P2A, al, bl , belief; 
unsigned short Area; 

PIXEL FIRJD, Green_D, IR_D, Red_D, Out; 
PIXEL FIR_V, Green_V, IR_V, Red_V; 
int d; 

50 al = ( spots [ index] . al > spots [ index J. bl ? spots [ index ]- al : spots [ index ]. bl ) 

bl = ( spots [ index] .al < spots [ index] .bl ? spots [ index ]. al : spots [ index ]. bl ) 
AR = ( (bl != 0) ? (double) (al )/(double ) (bl) : 0 ); 
if (AR > 10. ) { 
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70 spots [ index] . flag2 = 0; 

return ( D_NOTHING ) ; 

) 

if ( AR > 3.0) AR = 3.0; 
Area = spots ( index] .area ; 
if (Area > 500) Area = 500; 
^define MALUS 0 

^define GRAD_FILL( vl , v2, res) d«=vl-v2-MALUS;res=d; if (d<0) res=0;if (d>80) res=8 
15 GRAD_F I LL ( spots [ index] .grid_ar_mean, spots [ index ] .grid_cgl , FIR_D); 

GRAD_FILL( spots [ index ] . r_ar_jnean , spots [ index ] . red cgl , Red_D ) ; 
GRAD_FILL( spots [ index] .g_ar_roean, spots[index] .green cgl, Green_D) ; 
GRAD_FILL( spots [ index ] . i_ar_mean , spots [ index ] . ir_cgl , IR_P ) ** 

Green_V = spots [ index J. green_cgl ; 
Red_V = spots [ i ndex ] . red_cg 1 ; 
IR_V = spots [ index] . ir^cgl; 
20 F IR_ V = spots ( index] .grTd_cgl; 

P2A = spots [ index] .p2a ; 

if (P2A > 11.0) P2A =11.0; , 
Blemish_Class (AR, Area, FIRJ3, FIR_V, 
Green_D, Green_V, IR_D , IR_V, P2A f 
Red_D,Red_V, &Out); 
test_f Indecisions (&Out, ^belief, index); 
0K spots[Tndex] .f lag2 = Out; 

d9 spots [ index ] .dist = ( float )belief ; 

if (Out != D_NOTHING) { 

if (draw_flag) draw_contour_f ile(& spots ( index] , index, Out » 1, cam_nurab 

) 

if (Out = D_N0THING) spots [ index ]. flag2 = 0; 

return ( Out ) ; ' * . ■ 

) 

30 dummy ( a, b) 
{ 

printf("\n %d %d",a,b); 

select_contour_l( spots, spt_ind, mark, raarkl, cam_number) 
struct spot spots ( ] ; 
int spt_ind, mark, raarkl; 

35 { 

int cc_i [ MAX_SPOTS ] ; 

int cc_j[MAX_SPOTS] ; 

int ar_i j[MAX_SPOTS] ; 

int num[MAX_SPOTS] ; 

int i, j, flag, ret, il; 

int dist_i , dist_ j ; 

struct spot *spotl; 

40 int diff_area, area_lim; 

i = 0; 

flag = 0; 
* define BY_LARGEST_AREA 
#ifdef B Y_LARG E S T_ARE A 

ar_ij[0] = 0; 
felse 

45 ar_ij[0] = 10000; 

Sendif 

for (ret = 0; ret < spt_ind; ret++) 
{ 

spotl = &spots[ret]; 

if ( spot l->cam_n umber != cam_number) continue; 

if ( (spotl->area >= 0 && spotl->area < 3000) ) 

cn " ( 

50 flag = 0; 

for (j = 0; j < 0 ; j++) { 

disti = ABS(cc_i[j] - spotl->ci); 

dist_j = ABS(cc_j[j] - spotl->cj); 
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diff_area = ABS ( spotl->area - ar_ij[j]); 
10 area_lira = ( int )( (double )spotl->area * 0.45); 

if (dist_i < DELTA && dist_j < DELTA && diffarea < area_lim 
{ 

flag = l; 

#ifdef BY_LARGEST_AREA 

if( spotl->area > ar_ij[j]) 

#else 

15 if( spotl->area < ar_ij[j)) 



tfendif 



20 



25 



( 

il = num[ j] ; 

ar_ij[j] = spotl->area ; 
cc_i[j] - spotl->ci; 
cc_j[j] = spotl->cj; 
num[j] = ret; 

spots [ il J . f lagl = (unsigned char)markl; 
spotl->flagl = mark; 

} 

else { spotl->flagl = (unsigned char)markl; } 

} 

} 

if ( flag == 0) 
{ 



cc_i[ij = spotl->ci; 
cc_j[i] = spotl->cj; 
ar_ij[i] = spotl->area; 
spotl->flagl - (unsigned char)mark; 
num[i] = ret;. 
i++; 

30 ) 

> 

} 

} 

convert_area(spt, bndO, bndl, bnd2, cam_number ) 

struct boundary_data *bnd0, *bndl, *bnd2; 
struct spot *spt; 

35 ( 

double area_ratio, calc_area_ratio( ) ; 

int new_cj, new_ci; 

return(l); 

new^cj = spt -> cj; 
new_ci = spt -> ci; 
area_ratio = calc_area_ratio(cam_number, &new_cj, &new_ci , 
spt->area , 

40 bndO, bndl, bnd2, 

prog_consts . earner a_distance , 0 ) ; 

} 

convert_spo ts ( spots , f ina l_spots , count ) 
struct spot spots [], f inal_spots[] ; 

{ 

int i, f; 
45 f = 0; 

for (i = 0 ; i < count ; ++i ) 
{ 

if (f >= MAX_FINAL_SPOTS ) { 

printf ( n \n*** Too many spots' 1 ); return(f); 
} 

if ( spots [ i } . f lagl *= 0) continue; 
qq if ( spots [ i ] . f lag2 == 0) continue; 

memcpy(&f inal_spots[f ] , &spots[i], si zeof ( struct spot)); 
f ina l_spots [ f ] . f lag3 ~ i ; 
spots(i] .f lag3 = f; 
++f ; 
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> 

return ( f ) ; 
> 

displayf ound_contours( spots, spt_index, image) 
struct spot spots[J; 
PIXEL image [ FR_Y_S IZE] [ FR_X_S I ZE ] ; 

{ 

int i; 

15 SWAP_IN_SIZE( image, 0, norma l_images . green , FR_Y_SIZE*FR_X_SIZE) ; 

display iraage( 4 30, 0, image, FR_X_SIZE, FR__Y_SIZE, "cam 0")? 
SWAP_IN_SIZE( image, 1, norma l_images. green , FR_Y_SIZE*FR X_SIZE ) ; 

display_image(430, FR_Y_SIZE, image, FR_X_SIZE, FR_Y_SIZE, "cam 1"); 
SWAP_IN_SIZE( image, 2, norma l_images . green , FR_Y_SIZE*FR_X_SIZE) ; 

display_image(4 30, 2*FR_Y_SIZE, image, FR_X SIZE, FR_Y_SIZE, "cam 2")? 
for (i = 0 ; i < spt_index ; ++i) 
20 t 

display_single( SfSpotsf i ] , 253, l); 
printf ( "\n%3d -> %3d %3d" , i , spots [ i ] . f lag2 , spots[ i ] . f lagl ) ; 
} 

} 

display_single(spot , color, ind) 
struct spot *spot; 

25 [nt off_x, off_y; 
char name [ 16] ; 

off_x = 430; 

switch (spot->cam_number ) 
< 

case 0: off_y =0; break ; 
case Is off_y = FR_Y_SIZE; break; 
30 case 2: off_y = 2*FR_Y_SIZE; break; 

) 

draw_contour_f ile ( spot , spot->flag3, color, spot->cam__number , 

1, off_x, off_y); 

sprint f (name, "%ld M , ind); 

write__str(spot->c j+of f_x, ( spot->ci-l )+of f_y , name, 1, 252); 

) 

void 

insert_img( sp, x, y, z) 
struct spot *sp; 
double x , y , z ; 

{ 

sp->x = ( float )x; 
sp->y = ( float )y; 
sp->z = ( float )z; 
40 sp->ir_cgl = 33; 

sp->ir_cgl = 33; 
sp->ar = 99; 
sp->area = 66; 
sp->flagl = IMG_ST_CA; 
sp->flag4 = IKG_ST_CA; 
sp->flag2 = D_ST_CA; 

45 * 

look_f orthird (spots , spt_index, ca_index, mateindex) 
struct spot spotsfj; 

{ 

int third_index, i; 
int max_angle; 
#define MIN_DIST 0.7 

double angle_between_n ( double , double, double, double, double, double , double *) 
double angle_ca ,angle_st ,dist; 
max_angle - 0; 
third^index = -1; 

for (X = 0 ; i < spt_index ; ++i) 
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10 < 

if ( spots [i].flag4 REALJBLEMISH) continue; 
angle_st=angle_between_n ( spots ( i ] .x , spots ( i ] . y , spots [ i ] . z 

, spots [ ma te_index] .x , spots [ma te_index] . y, spots [ma te_index] . 
fidist) ; 

angle_ca=angle_between^n ( spots [ i } . x , spots ( i } . y , spots [ i ] . z 

, spots [ ca__Xndex ] . x , spots [ ca_index ] . y , spots [ ca_index J . z , 
&dist); 

15 angle_st = angle_st * 180. / 3.14159; 

angle_ca = angle_ca * 180. / 3.14159; 

if ( spots [ i ] .cam_number !- spots [ ca^index ] . cam_numbGr && 
spots [ i ] . cam_number ! = spots [ma te_index } . cam_number ) 

{ 

printf ("\n possible: %d %d %d %f %f" , i, ca_index ( mate_index, angle_ca , angle 
if (1 |! spots[ i] .dist > MIN DIST) { 
20 if (angle_st > maxangle |J angle_ca > max^angle ) 

{ max_angle = ( int ) (angle_st > angle_ca ? angle_st ; ang 
printf (■'... Chosen (%d)" , max_angle) ; 
third_index = i; 

) 

} 

I . • 

25 if (max_angle < MIN_ANGLE) third_index = -1; 

printf ( "\nthird: %d", third_index ) ; 

return ( third_index) ; - . 

} 

f ill_3d_info( spots, spt_index , bndo , bndl r bnd2, display_f lag ) 
struct boundary_data *bnd0, *bndl, *bnd2; 
struct spot spots [) ; 

30 ( 

int i,j, new_ci, new_cj, cam_number, cam_dist; 

double angle, angle_between_n( ) , v, max_angle, spot_max_angle ; 
char name [ 8 ] ; 
#define FLOAT double 

void St_ca_logic (FLOAT, FLOAT, FLOAT, FLOAT, FLOAT, FLOAT, FLOAT, FLOAT, PIXEL * 
FLOAT Angle, Darkness 1, Darkness_2 , Distance, 

Roundness_l, Round~ness_2 , Spot_l_Size, Spot_2 Size; 
PIXEL Which; 

int top_cand, max_grade; 
double distance, credibility; 
^define FUBYTE unsigned char 

#define FUBYTE_convert ( a ) (((double) a) / 255.0) 
extern FUBYTE _Rule0087_alpha ; 
float North£3) ,South[3] ; 
40 extern double dist; 

SWAP_IN_SIZE( bndO , CAM_1 , bnd , sizeof ( struct boundarydata ) ) ; 

SWAP_IN_SlZE(bndl, CAM_2, bnd, sizeof ( struct boundary_data ) ) ; 

SWAP_IN_SIZE(bnd2, CAM 3, bnd, sizeof ( struct boundary_data ) ) ; 
printf ( M \n++4-RADlUS : %f " , dTst ) ; 

for (i = 0 ; i < spt_index ; ++i) 
{ 

45 spots[i] .f lag 4 = REAL_BLEMISH ; 

if (debug_flag && display_f lag ) { 

draw_contour_f ile( 6cspots[i] , spots [ i ]. flag3 , 254, spots [ i ] .cam_n umber 
sprintf ( name , "%ld n , i ) ; 

write_str(3*spots[i] .cj, 3*(spots[ i ] .ci-1 ) , name, 1, 252); 
} 

cam_number = spots [ i ] - cam_number ; 
new_c j = spots [ i ] • c j ; 
50 new_ci — spots ( i J . ci ; 

cam_dist = prog_consts . camera_distance [ CAM 3]; 
f ind_3d_location ( cam_number , new c j , new cT , 

&spots[i].x, &spots[i].y, &spots[i).z, 
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bndO, bndl, bnd2 , 
prog_consts .camera_distance ) ; 

#ifdef EY^OLD 

Tf ( spots [ i ] . cain_number == CAM_1 ) { 

cam_dist = prog_consts . camera_d i stance [ CAM1 ] ; 
compute_3d_l( Gtspots[ i ] , bndo, cam_dist); 

} 

if ( spots [ i J .cam_n umber == CAM_2 ) { 

cam_dist » prog_consts. camera_di stance [CAM_2 ) ; 
compute_3d_l ( & spots { i] , bndl , cam_dist) ; 

} 

if ( spots [ i ] . cam_n umber =- CAM_3 ) { 

cam__dist = progconsts .camera_distance[CAM_3 ] ; 
compute_3d_l ( &spots[ i ] , bnd2 , cam_dist ) ; 

) 

end if 
) 

printf("\n step l"); 

imagin_stem_calix_coord (bndo , bndl , bnd2 , North , South , prog_consts . camera_distance 

printf("\n STEP 2 Norths %5 . 2f , %5 . 2f , %5 . 2f South= %5 . 2f , %5 . 2f , %5 . 2f 

North[0] ,North[l] , North [2] , South [0] ,South[l] ,South[2] ) ; 

(double ) North [0 ] , (double ) North [ 1 ] , ( double )Nort 



insert img ( & spots [ spt_index ] 
++spt_xndex; 
insert_ i _img(& spots [ spt_index) 
++spt_Tndex ; 
max_angle = 0; 

for ( i = 0 ; i < spt_index ; 
( 



( double) South [ 0 ] , (double) South[l ] , (double)Sout 



spots [ i ] . angle = 0 ; 
spot_max_angle =0; 
spots(i] .flagg - 0; 
max_grade = 0? 
top_cand = -l; 
if (dabug_flag) 
printf("\n cl c2) Angle Dist [Darkness] 
for (j = 0 ; j < spt_index ; ++j) 
( 



{ Si2e ) | Roundness] credibilit 



Angle = ( FLOAT )angle_between_n( spots [ i] .x, spots [i].y, spots [i).z, 

spots[j].x, spots[j].y, spots(j].z, 
^distance ) ; 

Angle = Angle * 180. / 3.14159; 

if (Angle > 180) Angle = 180; 

Distance = distance / dist; 

if (Distance > 1.0) Distance = 1.0; 

v = (double) ( (int)spots[i] .redcgl + 

( int ) spots [ i ). green_cgl + (int ) spots [ i] . ir_cgl ) ; 
Darkness_l - ( FLOAT) (v/3 .) ; 
v = (double) ( (int )spots[j] .red_cgl + 

(int) spots [ j] .greencgl + ( int) spots [ j ] . ir cgl); 
Darkness_2 = ( FLOAT) (v/3 . ) ; ~ 
v = ( FLOAT ) spots [ i ] . ar ; 

Roundness_l = 100. -v * 30.; if (Roundness_l < 1) Roundness_l = l 
v = ( FLOAT ) spots ( j ] . ar ; 

Roundness_2 - 100. -v * 30.; if (Roundness_2 < 1) Roundness_2 = 1 
if (Roundness_l > 100) Roundness_l = 100; 
if (Roundness_2 > 100) Roundness_2 = 100; 
Spot_l_Size = ( FLOAT) spots [i] .area/3.50; if (Spot_l_Size > 120) Spo 
Spot_2_Size = (FLOAT ) spots ( j] .area/3.50; if (Spot_2 Size > 120) Spo 
if (Spot_l_Size < 20) Spot_l_Size = ( FLOAT) spots [T] . area ; 
if (Spot 2 Size < 20) Spot 2 Size = ( FLOAT ) spots [ j] .area; 
#ifdef ST_FUZZY 

st_ca_logic (Angle, 

Darkness_i r Darkness_2, 
Distance, 
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in Roundness_l, Roundness_2 , 

Spot_l_Size, Spot_2_Size / 
& Which ) ; 

credibility = (double } FUBYTE_CONVERT(_Rule0087_alpha ) ; 
if (debug_flag) 

printf("\n %3d %3d) %5.1f %5.3f [%3.0f %3.0f] {%3.0f %3.0f) |%5.2f %5.2f| % 
i, j, Angle, Distance, Darkness_l, Darkness 2, 
Spot^l^Size, Spot_2_Size, Roundness_l , RounHness_2 , 
15 credibility, Which); 

if (Which > 100 && credibility >= raax_grade && 
Angle > max_angle) { 
max_angle *» Angle; 
raax_grade = credibility; 
spots[i] .f lag__g = Which; 
spots [ i ] .mate = j; 
2Q spots [ i ] .angle = Angle; 

spots [ i } .dist = distance; 

spots [ i j . f lagl = (unsigned char ) (credibility*255 . ) ; 

Sendif 

credibility = 1.0; 
if (spots[i] .flag4 == IMG_ST_CA |j spots [ j j . f lag4 == IMG_ST_CA) 
Angle = Angle * 0.8; 
if (debug_flag) 

25 printf("\n %3d %3d) %5.1f %5.3f [%3.0f %3.0f] (%3.0f %3.0f) |%5.2f %5 . 2f | % 

i , j , Angle , Distance , Darkness_l , Darkness 2 , 
Spot 1 Size, Spot_2_Size, Roundness_l, Roundness 2, 
credibility, Which); . , 

if (Angle > spot_raax_angle && distance > MIN_DIST && 

Spot_l Size > MIN_ST_AREA && Spot_2_Size >. ; MIN_ST_AREA & 
spots [ Tj. ir cgl < MIN_IR && spots [ j 3 . ir_cgl < MIN_IR && 
30 spots [ i ] . grid_cgl < MIN_FIR && spots [ j 3 . grid_cgl < MIN_IR 

spot_max_angle= ( int) Angle; 
spots[ i 3 ,angle= (int)Angle; 
spots [ i 3 . mate = j; 
spots [ i 3 .dist « Distance; 
) 

if (Angle > max_angle && distance > MIN_DIST && 

Spot_l Size > MIN_ST_AREA && Spot 2_Size > MIN_ST AREA & 
35 spots[T3.ir cgl < MIN_IR && spots[3] . ir_cgl < MIN_IR && 

spots[i3 ,grid_cgl < MIN_FIR && spots [ j3 .grid_cgl < MIN_IR 
max_angle = (int) Angle; 
maxgrade = 1.00; 
spots [ i3 . f lag_g = 200; 
spots [ i ] . mate = j; 
spots [ i 3 . angle = (int) Angle; 
4Q spots [ i 3 .dist = Distance; 

spots[i3 .flagl = 255; 

) 

} 

if (debug_flag) printf ( "\n" ) ; 
) 

return ( spt_index ) ; 

) 

45 Sifdef USE_FUZZY 

choose_stem_calyx( spots, spt index, display_f lag) 
struct spot spots[3; 

{ 

int i, max_i, max_cred, max_angle, max_dist, mate; 
max_cred = 0 ; 
max_angle = 0; 
§0 max_dist = 0; 

for ( i =* 0 ; i < spt index ; ++i ) 
{ 

if ( spots [i 3 .flag 2 == D_FARLAT ) ( 
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10 continue; ) 

if ( spots [ i ] . flagl >= max_cred) { 
max_cred = spots [ i ). flagl ; 
max_i = i ; 

) 

) 

printf ( "\nmax cred is: %d' , / max i); 
15 for (i = 0 ; i < spt_index ; ++T) 

if (spots[i] . f lag 2 = D_PARLAT) continue; 
if ( spots [ i ]• flagl < inax_cred) continue; 
if (spotsfij .angle >= max_angle) { 

maxangle = spots [ i ] . angle; 

raaxi = i; 

} 

20 ) 

printf ( "\nmax angle is: %d M , raax_i ) ; 
for (i = 0 ; i < spt_index ; ++i) 
{ 

if (spots [i] .flagl < max_cred) continue; 
if (spotsfi] .angle < max_angle) continue; 
if ( spots [i j .dist >= max_dist) { 
max_dist = spots[i] .dist; 
d5 max_i = i; 

> 

} 

printf ( "\nmax dist is: %d", max_i); 
mate = spots [ max_A ] .mate ; 

printf ( "\nChosen for Stem/Calyx: %3d %3d", max_i, mate); 
return ( max_i ) ; 

30 > 

#endif 

choose_stem_calyx( spots , spt_index, display_f lag) 
struct spot spots[]; 

{ 

int i, max_i, max_angle, max_dist, mate; 
max_angle = 0; 
max_dist «= 0; 

for (i = 0 ; i < spt_index ; ++i) 
{ 

printf ("\n angle : %d , i : %d" , spots [ i] . angle, i ) ; 

if ( spots [ i] .flag4 == IMG_ST_CA && spots [ spots [ i ] .mate! .flag4 = IMG_ST_CA) 
if (spots[iJ .angle >= max_angle && spots [ i ] .dist > MINDIST) { 

max_angle = spots[i] .angle; 

max_i = i; 

40 } > 

printf ( "\nmax angle is: ld" ( max angle); 
if <max_angle < MIN_ANGLE) { 
mate = -1; 
max_i = -1; 
J 

mate = spots [max_i] .mate; 
45 printf ( "\nChosen for Stem/Calyx: %3d %3d", max_i , mate); 

return ( max_i ) ; 

) 

cancel_no_zone_litter( spots , spt_index, image) 
struct spot spots [); 
PIXEL image[FR_Y_SIZE][FR_X_SIZE] ; 

int i , cara_in ; 

#def ine MIN_NO_ZONE_SPOT 35 
£ define MIN_NO_ZONE_CONTRAST 20 
cam in = -1; 
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10 for (i = 0 ; i < spt_index ; ++i) 

( 

if ( spots [ i ] . area > MIN_NO_ZONE_SPOT ) continue ; 
if ( spots [i] .f lag2 == D_ST_CA) continue; 

if (spotsfi] . ir_cgl - spots [ i ]. i_ar_mean > MIN_NO_ZONE CONTRAST) conti 
if (cain_in 1 = spots [ i ). cam__number ) { 
cam_in = spots [ i ] . cam_number; 
15 SWAP_IN_SIZE( image, cam_in, spots_3 , FR_Y_SIZE*FR_X_SIZE ) ; 

if ( image f spots [ij . ci ] [spots [ i] .cj] < 5) { 
spots[i) .flag2 = D_NOTHING; 

printf ( "\nNO_ZONE: %d %d %d",i, spots [i].cj f spots [ i ) . ci ) ; 

} 

) 

20 fill_color_mask( spots, spt_index , mask) 

struct spot spots []; 
PIXEL mask[FR y SIZE][FR X SIZE]; 

{ 

int i, j, ret, per, color , index , cam; 
char c_name[32]? 

char chain[CHAIN_SIZE] ; ■ * ' - 

index=0; " 
25 for (cam=0 ; cam < N_CAMERAS ; cam-r+) { 

for (i=0 ; i<FR_y_SIZE ; i++) ■ . ■ 

for (j=0 ; j<FR X_SIZE ; j++) mask[ i J ( j ]=100 ; 

for (index=0 ; Index < spt_index ; index++) 
( 

if (spots[i] .flag4 « REAL_BLEMISH ) continue; 

if ( spots [ index ] .cam_n umber i=cam ) continue; 
30 sprintf ( c_name , "%s%ld_%ld . cnt" , TMP_DEVICE, cam, spots [ index] . flag3 ) ; 

ret = undump spots (cname, chain, CHAIN SIZE, &per) ; 
if (ret FAILURE) { ~ 

printf ( "\nCont our file %s not found", c_name); return(l); 

if ( spotsf index] .flag 2==D_LROT && indexi=stem index && indexl=ca 
continue; ~ 

if ( (color=spin_color_blemish( spots [ index] .flag2) ) > 0) 
35 { 

draw_contour_mem(mask, (int ) spots [ index] . start_i , 

( int) spots [ index ] .start_j, chain, 0); 
malv_f ill_contour(mask, color, ( int) spots [ index ] .min_i , 
^ (int) spots [ index ].max_i, ( int ) spots [ index] .min_j , 

) 

^ printf ("\n at SWAP__0UT_. . combi_map index=%d" , index) ; 

SWAP_OUT_SIZE(mask, cam, combi_map , FR_Y_SIZE*FR_X_SIZE) ; 

) 

spin color_blemish( blemish) 

int Blemish; 

{ 

switch (blemish) 
45 ( 

case D ST CA : 



case D_ROT 
case D LROT 



return ( 1 ) ; 



return ( 5 ) ; 



case D_M0TH 

~ return (10); 

00 case D_RUSSET: 

return ( 7 ) ; 

case D BRUISE: 
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10 



15 



case D PIT 



case D PARLAT: 



case D NOTHING: 



default 



return ( 14 ) ; 

return ( 3 ) ; 

return ( 4 ) ; 

printf( M \n WARNING 
return ( 0 ) ; 

printf ("\n WARNING 
return ( 0 ) ? 



final contour fuond with flag2=D NOTHI 



: final contour fuond with flag2 not kno 



20 



25 



30 



35 



40 



45 



50 



dotrysingle st ca ( spots , sptindex ) 

struct spot spots f ] ; 

{ 



< spt index ; ++i) 



int i; 

for (i = 0 
( 

i f ( spots ( i ] . green_cgl 
spots ( i ] . red_cgl 
spots ( i ] . ir_cgl 
spots [ i ] . area > 10 



< 50 && 

< 50 && 

< 100 && 



) 



) 

return ( i ) ; 



return ( -1) ; 



pre_re_classif y( spots, spt_index, ca_indexp, mateindexp, th.ird_indexp ) 
struct spot spotsf]; 

int *ca_indexp, *mate indexp, *third indexp; 

( 

int i, j, ci, cj, area_diff; 

int ca_index, mate_index, third_index; 

float Angle ; 

double distance; 

^define SET_LABELS(ind, xmate) if ( ind>=0 ) {spots [ ind J . f lag2 = D_ST_CA; if (xmate> 
ca_index = *ca_indexp; 
roate_index = *mate_indexp; 
third_index = * third_ indexp ; 
SET_LABELS(third_index, ca index); 
SET_LABELS < ca_index , mate_Tndex ) ; 
SET_LABELS ( mate_index , ca_index ) ; 
for (i - 0 ; i < spt_index ; ++i) 



} 



if ( i == ca_index | j i = mate_index | | i 
if (spotsf i] .flag 2 •= D ST_CA) continue; 



third_index) continue; 



printf ( "\nChanged : ca_Xndex= %d 
spotsf il .f lag 2 = D_ROT; 



%d" ,ca_index , i ) ; 



correct_mate( spots, spt_index, caindexp, 
correct_raate (spots , spt_index, mate_indexp, 
ca_index = *ca_indexp; 
inate_index = *mate_indexp; 
third_index = *third_indexp; 
SET_LABELS ( third_index , ca index ) ; 
SET__LABELS ( ca_index , mate_Tndex ) ; 
SETJLABELS ( mate_index , ca_index ) ; 
for (i = 0 ? i < spt_index ; ++i) 



mate_indexp ) ; 
ca_indexp ) ; 



( 



if (x == ca_mdex | | i == mate_index | | i = third index) continue; 

if (spotsf i] .flag2 != D ST_CA) continue; 

printf ( "\nChanged : ca_Tndex= %d i= %d",ca index,i); 

spots [ i ] .flag2 = D_R0T; 
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) 

) 

10 correct mate (spots , spt_index, ca_indexp, mate__indexp) 

struct spot spots [ ] ; 
int *ca_indexp, *mate indexp; 

( 

int i, j, ci, cj, area_diff; 
i = *ca_ indexp; 

ci = spots[i].ci; cj = spots( i ) . c j ; 
15 for ( j - 0 ; j < spt_index ; ++j) 

( 

if (i == j) continue; 

if (» (spots [ j].flag2 == D_LROT (| spots [ j ]. flag2 == D_ROT) ) continue; 
if ( spots [ i ] .cam number I = spots [ j ] . canwiumber } continue; 
if ( 1 ( spots [ j] .mTn_i <= ci && spots [ j ]. max_i >= ci && 

spots [ j j -min__j <= cj && spots [ j ]. max_j >= cj)) continue; 
20 area_diff = spots [ j ] . area - spots [ i ]. area ; 

printf ( "\nKMM : %d %d %d %d %d",i, j, area_dif f , spots [ j ]. area , spots[ i ] . area ) ; 
if (area_diff < 0) continue; 
if (area_diff > 250) continue; 

printf ( "\nCa corrected: %d -> %d M , *ca_indexp, j); 
*ca_indexp = j ; 

) 

25 } 

reclassify ( spots, spt_index, ca_index, mate_index, third_index) 
struct spot spots []; 

{ 

int i, j, ci, cj, cgl_i , cgl_j ; 
Sifdef AAA 

for (i = 0 ; i < spt_index ; ++i) 

30 { 

if (i = ca_index | | i == mate_index | | i == third_index ) 

ci = spots (i].ci; cj = spots [i ]. cj ; 
for (j - 0 ; j < spt_index ; ++j) 

( 

if (j == i) continue; 

~- if (spots[i] .cam_number i = spots [ j] . cam_number ) continue; 

JO if ( spots [j].flag2 = D_ST_CA) continue; 

cgl_i = spots [j).ci; 

cgl_j = spots [j].cj ; 

if (cgl_i >= spots[i] .min_i && cgl_i <= spots [ i ] .max_i && 

cgl_j <= spots [ i ] .max_j && cgl_j <= spots [ i ) .max j ) 
spots { j ] . f lag2=D__NOTHING ; - 
if (ci >= spots [ j j . max_i && cj >= spots [ j ] .max_j && 
40 ci <= spots [ j ]. min_i && cj <= spots[j].min j) 

spots [ j ] . f lag2=D NOTHING; ~~ 

) 

) 

} 

Sendif 

for (i = o ; i < spt. index ; ++i) 
45 { 

if ( spots [ i] . f lag2 == D_ST CA) 
{ 

ci = spots ri].ci; cj = spots [ij.c j; 
for (j = 0 ; j < sptindex ; ++j) 
{ 

if (spots [j].flag2 D_ST_CA) continue; 
50 if (j == i) continue; 

if ( spots [ j ]. camn umber ! = spots[ i ] . cam_number ) continue; 
if (spotsf j] .f lag2 J = D ROT && spots[ j ] . f lag2 != D LROT) con 
if (ci <= spots [ j ]. max_T && cj <= spots [ j ]. max_j && 
ci >= spots [ j] .min_i && cj >= spots [ j ] . min_ j ) 
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spots [ j ] .f Iag2-D NOTHING; 

} 

10 ) 

) 

for (i = 0 ; i < spt_index ; ++i) 
i 

if (spotsfij .f lag2 == D_PIT) 
{ 

ci = spots [i].ci; cj = spots [i].cj; 
15 if (spotsfi] .f lag2 != D_PIT) continue; 

for (j = 0 ; j < spt__index ; 
{ 

if (j = i) continue; 

if ( spots r j ] .cam_number 1= spots [ i ] .cam__number) continue; 
if (spots[ j] .flag2 == D NOTHING) continue; 
if (ci <= spots [jJ.max_T && cj <= spots [ j ] .max_j && 
20 ci >= spots [ j] .min_i £& cj >= spots[j].min j) 

spots [ i ] . f lag2=D NOTHING ; 

} 

J 

) 

for (i = 0 ; i < spt_index ; ++i) 
{ 

25 if ( spots [ i ] .flag2 == D_ROT || spotsf i ] . f lag2 D_LROT) 

ci = spots [i).ci; cj = spots[i].cj; 

if ( spots [ i] .f lag2 D_ST_CA) continue; 

for ( j = 0 ; j < spt_index ; ++j) ' 
{ ' 
if (j == i) continue; 

30 if (spots[ j] .cara_number J- spots [ i ]. cam_number ) continue; 

if ( spots [ j ] .f lag 2 = D NOTHING) continue; 

if (ci <= spots [ j 1 . max_T && cj <= spots [ j ] -max_j && 

ci >= spots[ j] .min_i && cj >= spots [ j ]. min j) 
spots C i ] • f lag2=D NOTHING ; " " ~ 

) 

) 

35 ) 

for ( i = 0 ; i < spt index ; ++i ) 
( 

if ( spots [ij.f lag2 = D BRUISE) 
{ 

ci « spots [i].ci; cj = spots [i].cj; 
for (j « 0 ; j < spt_index ; ++j) 
40 { 

if ( j == i ) continue ; 

if ( spots [ j] .cam__number != spots [ i ]. cam number) continue; 

if ( spots [ j] ,flag2 == D NOTHING ) continue ; 

if (ci <= spots [ j ]. max_T && cj <= spots [ j ]. max_j && 

ci >= spots [ j ]. min_i && cj >= spots [j].min j) 
spots[i] .f lag2=D NOTHING; " 

45 ) 

) 

) 

) 

#define FUBYTE unsigned char 

^define FUB YTE_CONVERT ( a ) (((double) a) / 2 55.0) 
extern FUBYTE _Area_Tiny b_alpha; 
50 extern FUBYTE _Area_SmalT_b_alpha ; 

extern FUBYTE _Area_Medium_b alpha; 
extern FUBYTE _Area_Large_b_alpha ; 
extern FUBYTE _Area Huge_b_alpha ; 
extern FUBYTE _AR_Square_b_alpha; 
extern FUBYTE _AR_Bar_b_alpha; 
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extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 



extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 



_FIR__D_Poor_b_alpha ; 
_FIR_D_Low b_alpha; 
_FIR_D_MedTum_b_alpha ; 
_FIR_D_High_b_alpha ; 
_F I R_D_Ve ryHigh_b_a 1 pha 
_lR_D_Poor_b_a lpha ; 

IR_D_L.ow b_alpha; 
~ lR_D_Med Iuin_b_a lpha; 
extern FUBYTE _lR_D_High_b_alpha ; 
extern FUBYTE _lR_D_VeryHigh_b_alpha ; 
extern FUBYTE _IR_D_Well_b_alpha ; 
extern FUBYTE _P2A_Round_b_alpha ; 
extern FUBYTE _P2A_Oval_b_alpha ; 
extern FUBYTE _P2A_Odd_b__alpha ; 
FUBYTE _Red_D_Well_b_alpha; 
extern FUBYTE _RuleOOOO_alpha ; 

_Rule0017_alpha ; 
_Rule0018_alpha ; 
_Rule0015_alpha ; 
_Rule0016_alpha ; 
_Ru le 0 0 1 0_a lpha ; 
_Rule 0 011a lpha ; 
extern FUBYTE _Rule00l3_alpha ; 
extern FUBYTE _Rule0007_alpha ; 
extern FUBYTE _Rule0008_alpha ; 
extern FUBYTE _Rule0005_alpha ; 
extern FUBYTE _Rule0004_alpha ; 
extern FUBYTE _Rule0001_alpha ; 
extern FUBYTE _Rule0003_alpha ; 
extern FUBYTE _RuleO022_alpha; 
extern FUBYTE _Rule0023_alpha ; 
extern FUBYTE _Rule0025_alpha ; 
extern FUBYTE _Rule0027_alpha ; 
extern FUBYTE _Rule0028_alpha ; 
extern FUBYTE _Rule0029_alpha ; 
extern FUBYTE _Rule0030_alpha ; 
extern FUBYTE __Rule0032_alpha ; 
extern FUBYTE _Rule003 4_alpha ; 

_Rule003 6_alpha; 
_Rule003 7_alpha ; 
_Ru 1 eO 0 3 9_a 1 pha ; 
_Rule004l_alpha ; 
_RuleO 0 4 2_a lpha ; 
_Rule0044_alpha; 
_Ru 1 eO 0 4 6_a 1 pha ; 
extern FUBYTE _Rule004 7_alpha ; 
extern FUBYTE _Rule0048_alpha ; 
extern FUBYTE _Rule0050_alpha ; 
test_f l_decisions(Out, belief, ind) 
< 

double credibility, fmax, f; 
credibility = 0.0; 

credibility +- (double )FUBYTE_CONVERT(_RuleO 00 0_a lpha ) 
(double)FUBYTE_CONVERT(_Rule0018_alpha ) 
( double ) FUBYTE_CONVERT( _Rule0015_a lpha ) 
(double ) FUBYTE_CONVERT( _RuleO 016_a lpha ) 
( double )FUBYTE_CONVERT(_Rule0010_a lpha } 
(double ) FUBYTE_CONVERT( JRule0011_alpha ) 
credibility 4-= (double ) FUBYTE_CONVERT(_Rule0013_alpha ) 
credibility += (double) FUBYTE_CONVERT ( _Rule0007_a lpha ) 
credibility += (double) FUBYTE_CONV£RT( _Rule 000 8_a lpha ) 
credibility += (double)FUBYTE_CONVERT(_Rule0005_alpha ) 
credibility += ( double ) FUBYTE_CONVERT(_Rule0004_alpha ) 
credibility += (double) FUBYTE_CONVERT( _RuleO 00 l_a lpha ) 



extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 
extern FUBYTE 



PIXEL *Out; double *belief; int ind; 



credibility 
credibility 
credibility 
credibility 
credibility 
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credibility += ( double )FUB YTE_CONVERT(_Ru le0003_a lpha ) ; 
credibility += ( double ) FUBYTE_CONVERT( _RuleOO 2 3_alpha ) ; 
credibility += (double ) FUBYTE__CONVERT(_Ruleo 02 7_alpha ) ; 
credibility += (double ) FUBYTE_CONVERT( _Rule0028_a lpha ) ; 
credibility += ( double ) FUBYTE_CONVERT(_Rule00 29_alpha ) ; 
credibility += (double )FUBYTE_CONVERT(_Rule00 30_a lpha ) ; 
credibility +- (double ) FUBYTE_CONV£RT(_Rule003 2_alpha ) ; 
credibility += (double )FUBYTE_CONVERT(_Rule0 03 4_a lpha ) ; 
credibility += (double )FUBYTE_CONVERT(_Rule0036_alpha ) ; 
credibility += (double )FUB YTE_CONVERT ( _Ru leO 03 7_alpha ) ; 
credibility +- (double )FUBYTE_CONVERT(_Rule0039_alpha ) ; 
credibility += (double)FUBYTE_CONVERT(_Rule0041_alpha ) ; 
credibility += (double)FUBYTE_CONVERT(_Rule004 2_alpha ) ; 
credibility += ( double ) FUBYTE_CONVERT ( _Rule0 04 4_alpha ) ; 
credibility += (double ) FUBYTE_CONVERT ( _Rule00 4 6_alpha ) ; 
credibility += (double ) FUBYTE_CONVERT ( _Rule00 4 7_alpha ) ; 
credibility +- ( double )FUBYTE_CONVERT(_Rule00 4 8__a Ipha ) ; 
credibility (double )FUB YTE_CONVERT(_RuleOO 5 0_alpha ) ; 
if (credibility < 0-4) { 

*Out = D_NOTHING; 

*belief = 0.0; 

return ( 1 ) ; 

) 

rdefine DECIDE ( a, n) f = 
f >= fmax) 
fmax = 0.0; 
*Out = D_NOTHING; ' 
DECIDE (_Rule0017_alpha, 
DECIDE ( _Rule00 2 2_alpha , 
DECIDE (_Rule00 2 5_alpha, 
DECIDE ( _RuleO000_alpha , 
DECIDE (_Rule0 00 l_alpha, 
DECIDE (_Rule0003_a lpha , 
DECIDE(_Rule0004_alpha, 
DECIDE ( _Rule0 0 0 5_a J pha , 
DECIDE (_Rule0 00 7_a lpha, 
DECIDE (_Rule0 00 8_alpha, 
DECIDE(_Rule0010_alpha, 
DECIDE (_Rule0011_alpha , 
DECIDE ( JRuleOO 1 3_alpha , 
DECIDE (_Rule0015_alpha, 
DECIDE (_Rule0016_alpha, 
DECIDE (_Rule0018_alpha , 
DECIDE (_Rule0023_alpha , 
DECIDE ( JRuleOO 2 7_a lpha, 
DECIDE (_Rule0O 2 8_a lpha , 
DECIDE ( _Ru 1 eO 0 2 9_a lpha , 
DECIDE (_Rule00 30_alpha , 
DECIDE(_Rule00 3 2_alpha , 
DECIDE ( _RuleO0 3 4_a lpha , 
DECIDE (_Rule00 36_alpha , 
DECIDE (_Rule00 3 7_a lpha , 
DECIDE (_Rule0039_alpha, 
DECIDE(_Rule0041_alpha , 
DECIDE ( _Rule004 2_alpha , 
DECIDE(_Rule004 4_alr>ha, D_BRUISE) ; 
DECIDE(_Rule0046_alpha , D_BRUISE) ; 
DECIDE(_Rule0047_alpha, D_BRUISE) ; 
DECIDE (_Rule00 4 8_a lpha, D_PARLAT) ; 
DECIDE(_Rule0050_alpha , D_PIT) ; 
if (ind == 80) printf ( M \nDeci 80 
*belief = (float)fmax; 



( (double )FUBYTE_CONVERT(a ) ) J 
{ fmax = f ; *Out = n; ) 



D_NOTHING ) ; 
D_NOTHING ) ; 
D_NOTHING ) ; 
D_PIT ) ; 
D_PIT) ; 
D_PIT) ; 
D_LROT) ; 
D_LROT) ; 
D_PIT) ; 
D_PIT) ; 
D_LROT) ; 
D_LROT ) ; 
D_LROT ) ; 
D_LROT ) ; 
D_LROT ) ; 
D_PIT ) ; 
D_PIT ) ; 
D_ROT ) ; 
D_ROT ) ; 
D_BRUISE); 
D_BRUISE) ; 
D_BRUISE) ; 
D_BRUISE ) ; 
D_BRUISE) ; 
DJBRUISE) ; 
D_PIT ) ; 
D_BRUISE ) ; 
D ROT ) ; 



if (f > 0.34 && \ 



%d" 



*0ut) ; 



FL_debug ( Out ) 



PIXEL Out; 
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( 

^define TIL_WRITE fprintf 
^define T I L_D ATAF I LE stdout 
int count; 
char form[32J; 

TIL_WRITE (TIL_DATAFILE, 
TIL_WRITE ( TIL_DATAFILE , 
TIL_WRITE (TIL_DATAFILE, 
TIL_WRITE ( T I L_DATAF ILE, 
TIL WRITE (TIL DATAFILE, 



_ 20 



M \nArea:\tTiny\tSmall\tMedium\tLarge\tHuge\n" ) ; 
"\t%5.3f", FU B Y TE_C ONVER T ( Area Tiny b alpha)); 
»\t%5.3f", FUBYTE_CONVERT ( _Area~Sma lX b alpha)); 
"\t%5.3f", FUBYTE_CONVERT(_Area_Medium b alpha)) 
"\t%5 . 3f " , FUBYTE_CONVERT(_Area_Large_b_alpha ) ) ; 



TIL_WRITE ( TIL_DATAFILE , "\t%5.3f", FUBYTE_CONVERT ( Area"~Huge b alpha)) 
TIL_WRITE ( TIL_DATAFILE , "\nAR: \tSquar\tBar\n" ) ; ~ ™ ~ 



TIL_WRITE ( TIL_DATAFILE , 
TIL_WRITE ( TIL_DATAFILE , 
TIL_WRITE (TILD ATAF ILE, 
TIL_WRITE (TIL_DATAFILE, 
TIL_WRITE ( T I L_DATAF I LE , 
TIL_WRITE ( TIL_DATAF I LE , 
TIL_WRITE (TILJ5ATAFILE, 
TIL_WRITE (TIL_DATAFILE, 
TIL_WRITE ( TIL_DATAFILE , 
TIL_WRITE (TIL DATAFILE 



"\t%5.3f", FUBYTE_CONVERT( AR Square b alpha)); 
"\t%5.3f», FUBYTE_CONVERT(~AR~Bar b alpha)); 
"\nP2A: \tRound\tOval\tOdd\n" ) ; 

"\t%5.3f", FUBYTE_CONVERT(_P2A_Round b alpha)); 
"\t%5 . 3f " , FUBYTE_C0NVERT(_P2A_0val_b alpha ) ) ; 
"\t%5 . 3f " , FUB YT E_C ONVERT ( _P 2 A_Odd_b__a 1 ph a ) ) ; 
"\nFIR_D : \tPoor\tLow\tMediura\tHigh\tVeryHigh\n " ) 
"\t%5.3f", FUBYTE_CONVERT(_FIR D Poor b alpha)); 
"\t%5.3f", FUBYTE_CONVERT(_FIR D LOW b alpha)); 
"\t%5.3f , \ FUBYTE CONVERT( FIR D Medium b alpha) 
TIL_ WRITE (TIL_DATAFILE, "\t%5.3f", FUBYTE CONVERT ( ~FIR~D~~High b~aTpha ) ) ; 
TIL_WRITE (TIL_DATAFILE, "\t%5.3f», FUBYTE_CONVERT( — FIR~~D~VeryHigh b alph 
TIL_WRITE ( T I L_DAT AF I LE , »\nlR_D : \tPoor\ tLow\tMediuS\tHTgh\tVeryHiih\tWel 
TIL_WRITE (TIL_DATAFILE, "\t%5.3f", FUBYTECONVERT ( IR D Poor b alpha)); 
TIL_WRITE (TILJDATAFILE, "\t%5.3f»», FUBYTE CONVERT (~IR~D~Low b alpha )) ; 

TIL_WRITE ( TIL_DATAFILE , "\t?"); ~ ~ 

TIL_WRITE ( TIL_DATAFILE , *'\t?"); 
TIL_WRITE ( TIL_DATAFILE , "\t? '» ) ; 

TIL__WRITE ( TIL_DATAFILE , 
TIL_WRITE ( T 1 L_D AT AF I LE , 
TIL_WRITE (TIL_DATAFILE, 
TIL_WRITE ( TIL_DATAFILE , 
TIL_WRITE (TIL_DATAFILE, 
TIL__WRITE ( TIL_DATAFILE , 
TIL_WRITE ( TIL_DATAFILE 
TIL_WRITE ( TIL_DATAFILE 



"\t%5.3f", FUBYTE_CONVERT(_lR_D Well_b_alpha ) ) ; 
"\nRed_D:\tPoor\tLow\tMedium\tHlgh\t:VeryHigh\tWe 
"Vt?"); 
"\t?»); 
"\t?»); 
"Xt?") ; 

»\t? ) ; 

\t%5.3f FUBYTE__CONVERT ( _Red_D_We 1 l_b__a 1 pha ) ) ; 



TIL_WRITE ( TIL_DATAFILE , "\nLevel of belief :\n" ) ; 
count =0; 

#define TIL_WRITE_C( f , si ,d ,dl ) if((dl) > 0.0) { \ 

if (count > 0) sprintf (form, "\t%s" ,sl); else strcpyfforro, si) 
TIL_WRITE ( f , form , d , d 1 ) ; ++count ; ) \ 
if(count>42 J count ~ 0; TIL_WRITE( f , "\n")? ) 



TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL_WRITE_C 
TIL WRITE C 



( TIL_DATAFILE , "%3d. 

( TIL_DATAF ILE , " % 3d . . 

( TIL_DATAFILE , "%3d. . 

(TIL_DATAFILE / "%3d.. 

(TIL_DATAFILE, "%3d.-. 

( TIL_DATAFILE , "%3d . . 

( TIL_DATAFILE , " % 3d - . 

( TIL_DATAFILE , "%3d.. 

( TIL_DATAFILE , " % 3d . . 

( TIL_DATAFII.E , "%3d.. 

( TIL_DATAFILE , "%3d. . 

( TIL__D ATAF ILE , "%3d.. 
( TIL_D ATAF ILE , 
(TIL_DATAFILE, 

( TILJDATAFILE , " % 3d . 
( TIL_DATAFILE , 
( TIL_DATAFILE , 
( TIL_DATAFILE , 

( TIL_DATAFILE , "%3d. 

(TIL_DATAFILE, "%3d. 



%6.4f", 0, FUBYTE_CONVERT(_Rule0000 alpha 
%6.4f",17 f FUBYTE_CONVERT(_Rule0017 alpha 
%6.4f ",18 , FUBYTE_CONVERT(_Rule001S~alpha 
%6 . 4f ",15, FUBYTE_CONVERT(_Rule0015~alpha 
%6 . 4f ",16 , FUBYTE_C0NVERT(_Rule0016~alpha 
%6.4f" ,10, FUBYTE_CONVERT(_Rule0010 alpha 
%6.4f",ll, FUBYTE_CONVERT(_Rule0011 alpha 
%6 . 4f ",13 , FUBYTE_CONVERT(_Rule0013_alpha 
%6.4f", 7, FUBYTE_CONVERT(_Rule0007 alpha 
8, FUBYTE_CONVERT(_Rule0008^alpha 
5, FUBYTE_CONVERT(_Rule0005_alpha 
4, FUBYTE_CONVERT(_Rule0004 alpha 
1, FUBYTE_CONVERT(_Rule0001~alpha 
%6.4f" / 3, FUBYTE_CONVERT(_Rule0003~alpha 
%6.4f », 22, FUBYTE_CONVERT(_Rule00222alpha 
%6 . 4f » , 23 f FUBYTE_CONVERT(_Rule00 23_alpha 
%6.4f" ,25, FUBYTE_CONVERT(_Rule0025 alpha 
%6 . 4f » r 27 , FUBYTE_CONVERT(_Rule0027^alpha 
%6.4f " , 28, FUBYTE_CONVERT(_Rule0028~alpha 
% 6 . 4 f » , 2 9 , FUBYTE__CONVER T ( _Rul e 0 0 2 9~a lpha 



%6 ,4f " , 
%6. 4f " , 
%6.4f ", 
"%3d.. %6.4f", 
"%3d 



"%3d. 
"%3d. 
"%3d. 
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TIL_WRITE_C (TIL_DATAFILE, M %3d.. %6.4f",30, FUBYTE_CONVERT(_Rule0030_alpha 

TIL WRITE_C (TIL_DATAFILE, "%3d.. %6.4f",32, FUBYTE_CONVERT(_Rule00 3 2_alpha 

TIL_WRITE_C (TIL_DATAFILE, "%3d. . %6.4f",34, FUBYTE_CONVERT( _RUle00 34_alpha 

TIL_WRITEC (TIL_DATAFILE, "%3d.. %6.4f",36, FUBYTE_CONVERT ( _Ru le 0 0 3 6_a lpha 

10 TIL_WRITE_C (TIL_DATAFILE, "%3d.. %6.4f",37, FUBYTE_CONVERT(_Rule003 7_alpha 

TIL WRITE_C ( TIL_DATAFILE , "%3d.. %6.4f",39, FUBYTE_CONVERT(_Rule00 3 9_alpha 

TIL'WRITE C (TIL_DATAFILE, "%3d.. %6.4f",41, FUBYTE_CONVERT(_Rule0041_alpha 

TIL~" WRITE C (TIL DATAFILE, "%3d.. %6.4f",42, FUBYTE_CONVERT(Rule004 2_alpha 

TIL~WRITE2C (TIL_DATAFILE, "%3d.. %6.4f" v 44 ( FUBYTE_CONVERT(_Rule004 4_alpha 

TIL~WRITE C ( TIL_DATAFILE , "%3d. . %6.4f",46, FUBYTE_CONVERT( _Rule004 6_alpha 

TIL~WRITE~C ( TIL_DATAFILE , "%3d. . %6.4f M ,47, FUBYTE_CONVERT(_Rule0047_alpha 

f5 TIL~WRITE~C (TIL_DATAFILE, "%3d.. %6.4f",48, FUBYTE_CONVERT(_Rule004 8_alpha 

TIL~WRITE~C ( TIL_DATAFILE , "%3d.. %6.4f" ,50, FTJBYTE_CONVERT(_Rule0050_alpha 
TIL_WRITE (TIL_DATAFILE, "\n M ) 7 
^define DECISION(a, 11, 12, str ) if (a >= 11 && a < 12) printf ( "%s'\ str); 

printf ( "\nDecision: %3d ... ",Out); 

DECISION(Out, 0, 25, "St/Ca"); 

DECISION(Out , 25, 55, "Rot" ) ; 
20 DECISI0N(0ut r 55, 85, "Moth"); 

DEC IS ION (Out , 85, 115, "Large Rot"); 

DECISION(Out , 115, 145, "Russet"); 

DECISION (Out, 14 5, 175, "Bruise"); 

DECISION(Out, 175, 205, "Pit"); 

DECISION (Out, 205, 235, "Parlat" ) ; 

DECISION (Out, 235, 255, "Nothing"}; 
25 printf ("\n +"); 



30 



APPENDIX J 



35 



40 



45 



50 



119 



EP 0 566 397 A2 



/* 

ID: 017 

10 File name is: app!7.h 



*/ 

^include "\cfg\include\itexvsp.h M 

^include "\cfg\include\gaoi .h" 

^include "adapter. h" 

^include <time.h> 
15 ^include <conio.h> 

^include <process.h> 

#include <stdio.h> 

#include <ctype.h> 

^include <fcntl .h> 

^include <malloc.h> 

^include <stdl ib.h> 
20 ^include <limits.h> 

^include <signal .h> 

#indude <math.h> 

^include <setjmp.h> 

^include <float.h> 

^include <memory.h> 

^include <string.h> 
25 extern int debug flag; 

^define POSITIVE REF STEP (31.25/1000.) 

#define NEGATIVE REF STEP (23.05/1000.) 

^define NEGATIVE REF 0x1 

^define ~P0SITIVE~REF 0x2 .... 
#define EASE 0x345 

^define RE0_ADC (BASE + OxE) 

30 ^define RED ADC LUT (BASE + OxC) 

^define GREEN ADC (BASE + 0x12) 

^define GREEN_ADCJ_UT (BASE + 0x10) 

#define BLUE_ADC (BASE + 0x16) 

#define BIUE_ADC_LUT (BASE + 0x14) 

static int pen_x, pen_y; 

static int aoi ; 
35 static int Tnit count = 0; 

static char mod7fy_flag = 0; 

init_cfg() 

{ 

int finit_cfg(), ret; 
if (init count <= 0) 
{ 

40 ret - inquire sys(CFG); 

if (ret <= 0 T| init count < 0) { 

load cnf ( "c: \\eyaT\\cfg\\el op.cnf H ) ; 

} 

errjevel (SEVERE); 

_aoi = cfg_gaoi_fbcreate(CURRENT_F, 0, 0, 1023, 1023); 

restore setup dataQ; 
45 cfg sync(PLLj; 

cfg_vTdeosync(EXTSYNC) ; 

atexit (f init_cfg) ; 
++init count; 
} 

pen_x = pen y = 0; 

} ~~ 
50 reinit cfg() 

{ 

_aoi = cfg_gaoi_fbcreate(CURRENT_F, 0, 0, 1023, 1023); 

first time init cfg() 
{ " " " 
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initcount = -1; 
initsys() ; 
cfg im"t(); 
cfg_initltits() ; 
cfgcajnera(VIDEOO); 
init_cfg(); 
write_setup data(); 

set_color_cKannel_cfg( GREEN) ; 

15 zoom_cfg(0); 

pan_cfg(0,0) ; 
init_cotint = 1; 

restore_setup_data{) 

{ 

int in file; 

20 irTfile = open ( "c : \\ey_cfg . dat M , (0_RDONLY j 0_BIMARY) ) ; 

if"(in_file — -1) return (0); 

read(in file, & cfgsettings, sizeof (struct cfgdata)); 

close(in_file); 

cfg_setframe( cfg settings. colorplane) ; 

cfg_pan( cfg_settTngs .pan) ; 
cfg_scroTT( cfg_settings . scroll ) ; 
cfg zoom( cTg settings. zoom) ; 
25 } - - - 

wr i tesetupdata ( ) 
int out file; 

outfile = open( n c:\\ey_cfg.daf, (0 WRONLY | 0 CREAT | 

OJTRUNC J O BINARY), "[0200 | 0400") ); 
if (out file == -1) return(O); 

30 write(out_f ile, & cfg_settings, sizeof (struct cfg_data)); 

cl ose(out f i le) ; 

} 

move_abs_cfg(x,y) 
{ 

pen_x - x; pen_y « y; 

draw abs cfg(xl ,yl , col or) 
35 ( " " 

dline( pen x, pen_y, xl, yl, color); 

penx = xlT pen_y~= yl; 

} ~ 

finit_cfg() 
{ 

if (init count) 
40 { 

— init^count; 
if (modTfyflag) 

write setup data(); 

3 

gaoi delete( aoi); 
gaoi delall(GAOI USER); 

45 ) 

init grab cfg() 

{ ~ " 

cfg_videosync(EXTSYNC); 

set dac limits(l, 45); 
} " " 
grab cfg(camera) 

{ ~ 

w cfg_grab(camera, aoi); 

) 

stopgrab cfg() 
{ 
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10 int field; 

field = cfq field( ) ; 
if (field =^ EVEN) 
{ cfg_waitvb( ) ; cfg_endvb(>; } 

cfg_waitvb( ) ; 
cfg_freeze( ) ; 

} 

15 snap_cf g ( camera ) 
< 

cfg_snap( CAMERA, aci ) ; 

> 

shadow__snap_cf g ( camera ) 

cf g_snap ( aoi , aoi ) ; 

20 null_cfg() 
< 

J 

clear_screen_cf g ( color ) 
{ 

cfg_clf( aoi, color); 

> 

25 pan_cfg(x,y) 

cfg_pan(x) ; 
cfg_scroll(y ) ; 

cfg_set tings. pan = x; modify_flag - 1; 

cf gsettings . scroll = y; 

) 

zoom cfg( factor) 
30 { 

if (factor <= 1) factor = 0- 

cf g_settings . zoom = factor; rood_ry_flag = 1: 

cfg_zoom( factor ) ; 

) 

wpixel_rgb_cf g (x,y,r,g,b) 
( 

3S cfg_setf rame(R) ; 

cfg_wpixel( aoi, x,y,r); 

cf g_set frame (G) ; 

cfg_wpixel( aoi, x,y,g); 

cf g_setf rame ( B ) ; 
cfg_wpixel( aoi, x,y,b); 

) 

rpixel_rgb_cfg(x ,y ,r,g,b) int *r, *g, *b; 

40 ( 

cfg_setf rame(R) ; 

*r = cfg_rpixel( aoi, x,y); 

cfg_setfrarae(G) ; 

*g = cfg_rpixel( aoi, x,y); 

cf g_setf rame(B) ; 

*b = cfg_rpixel( aoi, x,y); 

„ ) 

set_color_channel_cf g ( chan ) 
( 

int f; 

switch (chan ) 
{ 

case RED: chan = R; break; 

case GREEN: chan = G; break ; 

50 case BLUE: chan = B; break? 

case FILLER: chan - O; break; 

case ENTIRE_DEPTH : chan = RGB; breaks- 
default; ; 
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10 > 

cfg_setf rame(chan) ; 

cf gsettings . color_plane = chan; modifyflag = 1; 

) 

get_color_channel_cfg( ) 
I 

int f; 

f - cfg_setfraroe ( INQUIRE ) ; 
* 5 switch (f) 

{ 

case R: f = RED; break; 

case G: f = GREEN ; break; 

case B: f = BLUE ; break; 

case RGB: f = ENTIRE_DEPTH; break; 

case 0; f = FILLER; break; 

20 > 

return ( f ) ; 

} 

wpixel_cf g(x , y,v) 
< 

cfg_wpixel( aoi, x,y,v); 

) 

rpixel_cf g ( x , y ) 
< 

cfg_rpixel( aoi, x,y); 

) 

set_plane_cf g ( n ) 
{ 

if (n == 1) cf g_setf rame(R) ; 
else if (n = 2) cfg_setf rarae(G) ; 
30 else if (n = 3) cfg_setframe(B) ; 

) 

whline_cfg(x, y, size, buf ) char *buf ; 

< 

cfg_bwhline( aoi, x, y, size r buf); 

) 

rhline_cfg(x , y, size, buf) char *buf; 

35 cfg_brhline( aoi, x, y, size, buf); 

J 

cfg_2_rara(array,xl,yl,x2,y2,xdst,ydst) PIXEL *array; 

( 

x2 = x2-xl; 
y2 -= yl; 
y2 += ydst; 
4Q for (yl = ydst ; yl < y2 ; ++yl ) 

{ 

cfg_brhline( aoi, xdst, yl , x2, array); 

array += x2; 

) 

) 

get_dfield (array, xl,yl,x2,y2 , xdst, ydst, field) PIXEL *array; 

45 int diff; 

x2 = x2-xl; 

diff = ydst & 0x1; 

diff += field; 

ydst -= diff; 
y2 -= yl; 
y2 +-» ydst; 

50 printf("\n diff: %d (%d *d)",diff, ydst, y2); 
for (yl = ydst ; yl < y2 ; yl += 2) 
{ 

cfg_brhline( aoi , xdst, yl , x2, array) ; 
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) 



array +=> x2; 

cfg_brhline( aoi , xdst, yl, x2, array ); 

array +=* x2; 



} 

get_block__fieldl( array, xl r yl , x2,y2, xdst, ydst) 
{ 

int diff; 

x2 = x2-xl; 

diff = yl - (yl & OxFFFE); 
if (diff == 0) { diff = l; 

yl -= diff; 

y2 -= diff; 

} 



PIXEL *array 



yl < y2 ; yl +- 2) 



y2 -» yl; 
y2 += ydst; 
for (yl - ydst 
{ 

cfg_brhline( aoi, xdst, yl . x2, array); 

array +« x2 ; 

cfg_brhline( aoi, xdst, yl, x2, array); 

array += x2; 

) 

} 

get_block_f ield 0 ( array , xl , y 1 , x2 , y2 , xdst , ydst ) 
{ 

int diff; 

X2 = X2-X1; 
diff = ydst & Oxl; 

ydst -= diff; 
y2 -= yxt 

y2 += ydst; 

printf("\n diff: %d ( %d %d)",diff, ydst, y2 ) ; 
for (yl = ydst ; yl < y2 ; yl += 2 J 
( 

cfg_brhline( aoi, xdst, yl f x2, array); 

array += x2; 

cfg_brhline( aoi, xdst, yl , x2, array); 

array += x2; 

) 

) 

ram_2_cf g ( array , x 1 , yl , x2 , y 2 , xdst , ydst ) 
{ 

x2 = x2-xl; 
y2 -= yl; 
y2 += ydst; 

for (yl = ydst ; yl < y2 ; ++yl ) 
{ 

cfg_bwhline( aoi, xdst, yl, x2 , array); 

array += x2; 

) 

dline_cfg(xl,yl,x2,y2, color) 

cfg_cline( aoi, xl , yl , x2 , y2, color); 

illed_rectangle_cfg(xl , yl ,x2 ,y2 , color) 

cfg_block( aoi, xl , yl , x2-xl, y2-yl , color); 

rectangle_cf g ( xl , yl , x2 , y2 , color ) 

cfg_rectangle( aoi, xl , yl, x2-xl-l, y2-yl-l, color); 



PIXEL *array; 



PIXEL *array; 
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f i lled_circle_cf g ( x , y , radius , color ) 

f illedrectangle_cfg(x-radius , y-radius , radius , y+radius , color ) ; 
circle_cfg(x, y, radius , color) 

cfg_circle( aoi, x,y, radius, 1, 1, color) ; 

text_cfg ( x , y , str i , size, color) char *stri ; 

cfg_text( aoi, x,y+10, 0 ,size. color, stri ) ; 

set_dac_limits_all(ll, hi, 12, h2, 13, h3 ) 
nt v; 

if define P_LUT_REF(1, h, adc_lut, adc) \ 
outp( adc_lut , _NEGATIVE_REF ) ; \ 

v « (int) ( (double )1 * 2. / ( NEGATIVE_REF_STEP * 1000.) +.5); \ 
outp(adc, (v « 2) & OxFC); \ 
ou tp ( adc_l Ut , _POS I TI VE_REF ) ? \ 

v = ( int) ( (double )h * 2. / ( POSITIVE_REF_STEP * 1000.) +.5); \ 
outp ( adc , ( v « 2 ) & OxFC ) ; 

P_LUT_REF (11, hi , RE D_ADC_LUT , RED_ADC ) ; 
P_LUT_REF (12, h 2 , GREEN_ADC_LUT , GREEW_ADC ) ; 
P_LUT_REF (13, h 3 , BLUE_ADC_LUT , BLUE_ADC ) ; 

) 

set_dac_limits (n_ref , p_ref ) 
( 

outp ( BLUE_ADC_LUT , _NEG AT I VE_REF ) ; 
outp ( BLUE_ADC , (n_ref « 2 ) & OxFC); 
outp ( BLUE_ADC_LUT , J?OSITIVE_REF ) ; 
outp(BLUE_ADC, (p_ref « 2) & OxFC); 
outp ( R£D_ADC_LUT , NEGATI VE_REF ) ; 
cutp(RED_ADC, (n_ref << 2) & OxFC); 
outp ( RED_ADC_LUT , _POSITIVE_REF ) ; 
OUtp(RED_ADC, (p_ref « 2) & OXFC); 
outp ( GREEN_ADC_LUT , _NEGAT I VE_REF ) ; 
outp(GREEN_ADC, (n_ref << 2) & OxFC); 
outp ( GRE EN_ADC__LUT , _POS ITIVE_REF ) ; 
outp(GREEN_ADC, (P_ref « 2) & OxFC); 

} 

get_dac_lirai ts ( n_ref , p_ref ) 
int *n_ref, *p_ref; 

< 

outp ( RED_ADC_LUT , _NEG AT I VE__REF ) ; 
*n_ref = ( ( inp ( RED_ADC ) » 2) & 0x3F) ; 
outp ( RED_ADC_LUT , _POSITIVE_REF ) ; 
*p_ref = ( (inp(RED_ADC) » 2) & 0x3F); 

) 

jmp_buf jmp_mark; 
^define stat_port 0x2 fd 
#define OUT_PORT 0x2f8 
#define IN_PORT 0x2f8 
sdefine INT_DIVISOR 0x2f9 
Sdefine INT_ID 0x2fa 
^define LINE_CONTROL 0x2fb 
i define MODEM CONTROL Ox2fc 



^define LINE_STATUS 
#define MODEM_S T ATUS 
rdefine etext_image 
#define direct_line 
p_ctl_c_handler( ) 
{ 

char c; 



0x2fd 
0x3fe 

write_str 

dline 
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signal (SIGINT, 5IG_IGN) ; 
sifdef AAA 

printf("\n Terminate Processing? [y|n] "); 
10 c = getch( ) ; 

if (c == * Y ' || c == 'y') { printf(" Yes, please terminate ! \n" ) ; 

escape ( "OK, good Bye"); ) 
else printf( M Not yet, Man. Maby next time."); 
signal (SIGINT , ctl_c_handler ) ; 
sendif 

exit (I) ; 

) 

void 

p_f loat_handler(int sig, int num ) 
{ 

extern int p_errno; 
_f preset ( ) ; 
p errno = FLOAT_ERROR; 
long jmp( jmp_mark, -1 ) ; 

) 

init_exception_handlers( ) 
{ 

if (signal (SIGINT, p_ctl_c_handler ) ( int (*)()) -1 ) { printf ( "Can 1 1 set signa 

) . . - 

display_datum_line(x,y ,val , header ) char *header; 

{ ,* • 

char s [ 3 2 ] ; 

sprintf(s, "%s: %4d", header, val ) ; 

write_str(x, y, s, l, 255); i . - ; 

} 

draw_boundary (boundary, boundary_index, out_rect, off_x, off_y, b_color , rect_col 
30 struct line_pair boundary[ ] ; 

struct rect out_rect; 

{ 

int i,xl,x2,y; 

for (i = 0 ; i < boundary_index ; ++i) 
{ 

y = boundary [ i] .y + off_y; 
35 xl = boundaryfi] .xl + off_x; 

x2 = boundary [ i ] .x2 + off_x; 
wpixel (xl ,y ,b_color ) ; 
wpixel ( x2 , y , b_color ) ; 

) 

if (rect_color >= 0) ( 
dline(out_rect. xl+of f_x, out_rect . yi+of f _y , out_rect . x2+of f_x, out^rect . yl+o 
40 dline(out_rect.x2+of f_x, out_rect.yl+of f_y, out_rect .x2+of f_x , out_rect . y2+o 

dline(out_rect.x2+of f_x, out_rect . y2+of f_y , out_rect . xl+of f_x, out_rect . y2+o 
dline(out_rect. xl+of f_x, out_rect . y2+of f_y , out_rect. xl+of f_x, out_rect.yl+o 
) 

) 

display_fr_256( image , xl , yl, x2, y2 , xs , ys) 

PIXELS _far image[FR_Y_SIZE][FR_X_SIZE]; 

45 ( 

copy_block( image, xs ,ys,x2-xl ,y2-yl ,xs ,ys) ; 

) 

read_fr_pic(f ile_name,mat,size_x,size_y , magic, header) 
PIXEL _far *mat; char f ile_name[ ] ; 
char * header ; 

int *size_x, *size_y, *magic; 

SO { 

long btbr, bytes_read; 

^define PACKET_SIZE ( INT_MAX & Oxf f f c ) 
int in_file,pz; 
long 1[4] ; 
^define L_SIZE 3 
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in_file = open( f ile_name , (o_RDONLY | 0_binary) , 0) ; 
10 if (in_file «~ -1) return(O); 

if ( read(in_f ile, 1, 4*L_SIZE) != 4*L_SIZE) < printf ( »\n error in read #1") 
close ( in_file ) ; return ( FAILURE ) ; ) 

*size x = (int)l[l] ; 

*size~y = (int)l[2]; 

btbr = (long) (*size_y) ; 

btbr = btbr * (*size_x); 

while ( btbr > 0 ) 
15 ( 

if (btbr > PACKET_SIZE) pz = PACKET_SIZE; 
else pz = (int) btbr; 

bytes_read = read( in_f ile , mat, pz ) ? 
btbr -= pz; 
mat += pz; 

) 

20 close ( in_f lie) ; 

re turn (SUCCESS ) ; 

) 

read_f r_pic_extended( f ilename ,mat, size_x,size_y , magic , header) 
PIXEL. _far *mat; char file_name[]; 
char * header; 

int *size_x, *size_y, *magic; 

25 ( 

long btbr, bytes_read; 

fcdefine PACKET_SIZE ( INT_MAX & Oxfffc) 
int in_file,pz; 
long 1[ 4 ] ; 
#define LSIZE 3 

• in_file » open( f i*le_name ; (0_RDONLY | 0_BINARY ) , 0) ; 1 fc \ 

if (in_file = -l) return(O); 

if ( read(in_file, 1, 4*L_SIZE) i = 4*L_SIZE) ( printf (»\n error in read #1") 

close(in_f ile) ; return ( FAILURE ) ; } 
*size_x = (int)l[l]; 
*size_y = (int)l[2]; 
btbr = (long) ( *size_y) ; 
btbr - btbr * (*size_x); 
while ( btbr > 0 ) 
{ 

if (btbr > PACKET_SIZE) pz = PACKETSIZE; 
else pz = (int) btbr; 

bytes_read = read( inf ile , mat, pz ) ; 
btbr -= pz; 
mat += pz ; 

) 

40 bytes_read = read ( in_f ile, header, FR_HEADER_SIZE) ; 

if (bytes_read != FR_HEADER_SIZE) { close ( in_f ile ) ; return(lO); > 
close(in_f ile) ; 
return ( SUCCESS ) ; 

) 

read_mtrx__pic( f ile_name ,mat , x , y ) 

PIXEL _far *mat; char file_name[]; 

45 < 

int infile, pz ; 

long btbr , by tesread ; 

in_file = open(file_name, ( 0_RDONLY | 0_BINARY) , 0) ; 
if (in_file =- -1) return(O); 
btbr = (long)(y); 
btbr *= (x); 
while ( btbr > 0 ) 
50 { 

if (btbr > PACKET_SIZE) pz = PACKETSIZE; 
else pz = (int) btbr; 

bytes_read = read (in_f ile, mat, pz ) ; 
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if (bytes_read != pz) 

{ fprintf (stderr, "err 2"); close( in_f ile ) ; return ( FAILURE) ; } 
btbr — pz ; 
mat += pz; 

) 

close (in_f ile) ; 
return ( SUCCESS ) ; 
) 

15 wr i t e_f r_p i c ( f i le_name , ma t , s i ze_x , s i ze_y , heade r ) 
PIXEL _far *mat; char f ile_name[ J ; 
int size_x, size_y; 
char * header; 

I 

int out__file, pz ; 
long bytes_written, btbr; 
20 long 1[4]; 

out_file = open(f ilename, (0_WRONLY | 0_CREAT j 
0_TRUNC | G_BINARY), (0200 | 0400) ); 

if (out_file — -1) retum(O); 

1[0] = C long) 100; 

1[1] = (long )size_x; 

1[2] = ( long )size_y; 

1[3] = <long)0; 

25 if ( write (out_f ile, 1, L_SIZE*4) != L_SI2E*4) ( printf ( "\n error in write # 

close(out_f ile) ; return ( FAILURE ) ; } 
btbr = (long) (size_y ) ; 

btbr *= (size_x); ■ 

while ( btbr > 0 ) ' * ' ' 

< • 1 — t - - 

if (btbr > PACKET_SIZE) pz - PACKET_SIZE; ' 
30 else pz = (int) btbr; 

bytes_written = write ( out_f ile , mat, pz); 
if (bytes_written I- pz ) 

{ fprintf (stderr, "err 2"); close(out_f ile) ; return ( FAILURE ) ; } 
btbr -= pz; 
mat += pz ; 

) 

35 bytes_written = write (out_f ile, header, FR__HEADER_SIZE) ; 

if (bytes_written 1= FR_HEADER_SIZE) { close(out_f ile) ; return ( FAILURE ) ; ) 
close ( out_file ) ; 
return (SUCCESS) ; 
) 

compute_his_f r( image, margins, his) 

PIXELS _far image [ FR_Y_SIZE ] [FR_X_SIZE] ; 
unsigned int his[256]; 

40 { 

int line, i,j; 
unsigned int pix; 

for (i = O ; i < 256 ; ++i) his[i] = 0; 
for (i = 0+margins ; i < FR_Y_SIZE-margins ; ++i ) 
for (j = 0+margins ; j < FR_X_SIZE-margins ; ++j) 
( 

45 pix = (unsigned int) imagef i ] [ j ] ; 

if (pix <= 2) continue; 
++his[pix] ; 

} 

return ( SUCCESS ) ; 

) 

smooth_his(his , hisl) 
50 unsigned int his [256]; 

unsigned int hisl[256]; 

( 

int line, i,j; 
unsigned int pix; 
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20 



for (i = 1 ; i < 256-1 ; ++i ) 
10 hislfi] = (his[i-l]+histi)+his[ i]+his[ i+1 ) ) » 2; 

hislfO] = hisl[l]; 
hisl[255] - hisl[255-l] ; 
return (SUCCESS) ; 

} 

display_histogram_f r(his, low_thresh, up_thresh f color) 
unsigned int his [256]; 

15 { 

int i, max_i,x , yl, y2 ; 
unsigned int min, max; 
double factor; 
char string [ 10 ] ; 
=define xdelta 64 

etext_image(160+XDELTA, 120, "MAGNITUDE DISTRIBUTION", 1,255,1); 
min = UINT_MAX ; 
max = 0; 
max_i ~ -1; 
Fdefine X_START low_thresh 
=define XEND upthresh 

for (i «=■ X_START ; i < X_END ; { 

if (his[i] > max) { max = hisfi]; max_i = i; ) 
if (his[ij < min) min = his[i]; 

25 ) 

if (max_i == -1) return ( FAILURE ) ; 
if (max == min) max = min+1; 
factor - 255. / (float) (max - min); 
X = (X_START + 1) * 2; 

yl = 480 - ( int ) ( ( his { X_START ] - min) * factor + .5) - 1 - 50; 
for (i = X_START + 1 ; X < X_END ; ++i) ( 
30 y2 - 480 - ( int ) ( (his[ i ] - min) * factor + .5) - 1 - 50; 

direct_line(x+XDELTA,yl,x+2+XDELTA,y2,color) ; 

direct_line ( x+XDELTA, yl-1 , x+2+XDELTA , y2~l , color) ; 

x += 2; 

yl = y2; 

> 

yl = 480 - 50 + 15; 
35 X = 0; 

*° direct_line(0+XDELTA, yl , 512+XDELTA, yl , 254); 

direct_line(0+XDELTA, 175, 512+XDELTA, 175, 254); 
for (i - 1 ; i <= (512+1) ; i += 64) 
i 

direct_line(i+XDELTA, yl, i+x delta , yl + 10, 254); 
direct_line(i-l+XDELTA, yl , i-l+XDELTA, yl + 10, 254); 
direct_line(i+l+XDELTA, yl, i+l+XDELTA, yl + 10, 254); 
40 direct_line(i+2+XDELTA, yl, i-t-2+XDELTA, yl + 10, 254); 

sprintf (string, "%4d",x) ; 

etext_image ( i - 10+XDELTA ,yl + 15, string, 1, 254, 2); 

x += 32; 

) 

i = 480 - 0 - 1 - 50; 

direct_line(0+XDELTA, 445, 0+XDELTA, 175, 254); 
45 direct_line( 512+XDELTA, 445, 512+XDELTA, 175, 254); 

for (yl = lOO ; yl >= 0 ; yl -= 40) 
{ 

y2 = i - (int) ( (float)yl * 2.55); 

direct_line(0 + XDELTA, y2, 6 + XDELTA, y2, 254); 

direct_line(0 + XDELTA, y2+l, 6 + XDELTA, y2+l, 254); 

direct_line(512 + XDELTA, y2, 512-6 + XDELTA, y2 , 254); 
„ direct_line(512 + XDELTA, y2+l , 512-6 + XDELTA, y2+l , 254); 

50 sprintf (string, "%ld%%" ,yl ) ; 

if (yl > 0) etext_image ( 1 2 + XDELTA , y2 - 10, string, 1,254,2); 

) 

yl = 4 80 - his[max_i] - 1 - 50; 



55 



129 




EP 0 566 397 A2 



sprintf (string, "%ld" , max_i ) ; 
return ( SUCCESS ) ; 

10 ) 

compute_accumulated(his , hisl, low_thresh, high_thresh) 

unsigned int his[256]; 
unsigned int hisl [ 256 ]; 

{ 

int i ; 

if (low_thresh <= 0) low_thresh = 1; 
15 hisl[low_thresh-l] = Or 

for (i = low_thresh ; i < high_thresh ; ++i) 

hisl[i] = hisl[i-l]+his[i] ; 

) 

get_per_data( f ile name, boundary, boundary_index , out_rect) 
struct llne_pair boundary [MAX_B0UNDARY J ; 
int *boundary_index ; 
20 struct rect *out_rect; 

char *file_narae; 

t 

int in__file, bytes_read, by? 

in_file = open ( f i le_name , ( 0_RDONLY j 0_BINARY ) , 0); 
if (in_file -1) {printf("\n BND file %s not found", f ile_narae ) ; 
return ( FAILURE ) ; ) 
25 #define read_it(a,b,c,d) by = sizeof(a) * d; \ 

bytes_read = read ( in_f ile , b, by); \ 
if (bytes_read != by) \ *■ 
{ fprintf (stderr, "DR-err %ld M / c); close ( in_f ile ) ; return ( FAILURE ) ; 
read_it(int, boundary_index , 1,1); ; 
read_it( struct rect, out_rect, 2, l)r 

readmit (struct line_pair, boundary, 3, *boundary_index ) ; 
30 close(in_f ile) ; 

return (SUCCESS) ; 

} 

dump_per_data(f ile_name , boundary, boundary_index , out_rect) 
struct line_pair boundary [ MAX_BODNDARY ] ; 
int boundary_index; 
struct rect *out_rect; 
35 char *file_narae; 

{ 

int out_file, bytes_written , by; 

out_file = open(f ile_name, (0_WRONLY | 0_CREAT | 

0_TRUNC | 0_BINARY), (0200 | 0400) ); 
if (out_file — -1) {printf("\n Unable to open dump"); return ( FAILURE) ; ) 
^define write_it ( a , b , c , d ) by = sizeof(a) * d; \ 

40 bytes_written = write ( out_f ile , b, by); \ 

if (bytes_written != by) \ 
{ fprintf (stderr, "D-err %ld" ,c); close { out_f ile ) ; return ( FAILURE ) ; 
write_it( int , &boundary_index , 1, 1); 
write_it( struct rect, out_rect, 2, 1); 

write_it( struct line_pair, boundary, 3, boundary_index ) ; 
close (out_f ile) ; 
45 return ( SUCCESS ) ; 

} 

= ifdef DEM0__1 
grid_light( ) 
< 

unsigned char c; 

c = inp( MODEM CONTROL); 
50 c = 1; 

outp ( MODEM_CONTROL , c ) ; 

) 

d i f f us e_l ight ( v ) 

{ 

unsigned char c; 



130 



EP 0 566 397 A2 



10 



c = inp(MODEM_CONTROL) ; 
c = 2; 

outp ( MODEM_CONTROL , c ) ; 

) 

no_light( v) 



unsigned char c; 

C = inp(MODEM_CONTR0L) ; 
c — 3 ; 

outp(MODEM CONTROL, c); 

15 ) 

#endif 

speaker_beep( f req , durl , dur2, count) 
( 

int clkl, clk2; 
unsigned char p; 
20 union ( 

unsigned short divisor; 
unsigned char c[2]; 
) cn; 

cn. divisor = (unsigned short )( 1193180 . / ( double ) f req ) ; 
outp (67, 18 2); 
outp(66, cn.c[0]); 
25 outp(66, cn.c[l]); 

p = inp(97); 

for ( ; count ; — count) 
{ 

clkl = clock ( ) ; 
outp(97, p | 3); 
do { 

30 clk2 = clock () - clkl; 

) while (clk2 < durl); 
clkl = clock< ) ; 
OUtp(97, p & 253); 
do { 

clk2 = clock() - clkl; 
} while (clk2 < dur2); 

35 > 

outp (97 , p & 253 ) ; 

} 

extern struct single_view_inf o view_info[N CAMERAS ] ; 

#ifdef EYAL_OLD 

#pragma optimize ( ,,H , off) 

correct_vires^presence { image , wireless_image , bnd) 
40 PIXEL image [ FR_Y_S IZE] [ FR_X_S IZE]; 

PIXEL wireless_image[FR_Y_SIZE] [FR_X_SIZE] ; 
struct boundary_data *bnd; 

{ 

#define DO_CANCEL_WlRES 
ififdef DO_CANCEL_WTRES 
i? define ENV l 
45 pdefine N_PART 7 

int i,j, k, 1, v/, z; 

doubl e x [ N_PART ] , y [ N_PART ] ; 

for (i = 0 ; i < FRYSIZE ; ++i) 

( 

for (j = 0 ; j < FR_X_SIZE ; ++j) 
50 < 

if (image[i] [j] == WIRE_MARK) 

( < 

for (k = j+1 ; k < FR_X SIZE && image[i][k] == WIRE_MARK ; ++k) 
y[0] = (double ) image [T] [ j-ENV-2] ; x[0] = (double) ( j-ENV-2 ) ; 
y[l] = (double ) image [ i }[ j-ENV-i] ; x[l] = (double )( j-ENV-1 ) ; 
y[2] - (double ) image [ i ] [ j-ENV] ; x[2] = ( double ) ( j— ENV) ; 
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15 



20 



frifdef AAA 



#endif 



y[3] = (double )image(i] [k+ENV] ; x[3] 

y[4] = (double )image[ i ] [k+ENV+1] ; x[4] 

y[5] = (double) image [ i ] [k+ENV+2] ; x[5] 

y[6] = (double) image[ i] [k+ENV+3 } ; x[6] 



(double) (k+ENV) ; 
(double) (k+ENV+1 ) ; 
(double) (k+ENV+2) ; 
(double) (k+ENV+3 ) ; 



if (y[OJ > 253 | 



y[6] > 253) { 

wi re 1 ess_image [ i ] [ j ] 

continue; 



image[i][ j] ; 



for 
{ 



(1 = j-ENV-2 ; 1 <= k+ENV+2 ; ++1) 



w - lin_interp( 1 , x ,y ,N_PART); 
w - (w + wireless_image[ i-1 ] [ 1 ) ) >> 1 ; 
wireless_image[ i ] [ 1 ] = w; 

j - l-i; 



else 



vireless_image[i] [ j] = image [ i ] [ j ] ; 



25 



clear_outside (wireless_image , bnd->boundary , bnd->boundary_index, 

#else 

memcpyf wireless image, image, FR Y SIZE * FR X SIZE) ; 
lendif "** • 



255) ; 



ly'.nn) 

double x[ ] , y[ ] ; unsigned nn; 



30 



35 



40 



45 



50 



lin_interp(xO, x 
int xO; 

{ 

double m, n, yl, y2, xl , x2, yO ; 
int i; 

xl = x[0]; yl = y[0]; 
x2 = x[nn-l]; y2 = y[nn-l]; 
yl = 255. ; 

for (i = 0 ; i < nn ; ++i ) 

if (y[i] < 253) { yl = y[i}; break; ) 
if (yl 255.) return( (int)y[0] ) ; 
y2 = 255. ; 

for (i = nn-1 ; i ; — i) 

if (y[i] < 253) { y2 - y[i]; break; ) 
if (yl == y2) return (( int) yl ) ; 

if (xl == x2) { printf("\n Err"); return(O); ) 

m = (y2-yl) / (x2-xl) ; 

n = y2 - m*x2; 

yO = (double )x0 * m + n; 

return ( (int) (yo + 0.5)); 

) 

#pragma optimize ( 11 " , on) 
#endif 

cancel_wires_n ( l_image , l_image_l, bnd , cam_number ,pic_n,x_of f set ) 
PIXEL l_image [ l_fr_ Y_s I z E ] [ L_FR_x_S I ZE ] ; 
PIXEL l_image_l[L_FR_Y_SIZE] [L_FR_X_SIZE) ; 
struct boundary_data *bnd; 
int pic_n , x_of f set ; 



{ 



int complete shape ( ) ; 

int i , j , 1 ; 

int cam_0_wi relocations (4 ] [3 j [ 2] = { 29, 38, 51, 59, o, o, 

32, 41, 53, 61, 0, 0, 
30, 39, 51, 58, 0 r 0, 
30, 39, 51, 58, 0, 0 }; 

int cam_2_wire_locations[4] [3] [2)={52, 62, 104, 114, 137, 145, 

52, 62, 104, 114, 137, 145, 
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50, 64, 103 ,115 ,133 ,145, 
ro, 64, 103 ,115 ,133 ,145 ); 

10 for ( i=0 ; i<4 ; i++ ) 

for ( j=0; j<3; j++ ) 
for (1=0;1<2;1++) 
{ 

cam_2_wire_l oca t ions [i]CjJ[lJ~= x_of f set ; 
if( cam_0_wi re_l oca t ions [ i] [ j ) [ 1] ) 

cam O_wire_locations[i][ j][l j-= x_offset; 

15 ) 

i f ( cam_number=CAM_l ) 
{ 

if (pic_n— 0) 
( 

correct_cam_0_bnd ( l_image , bnd , cam_number , cam_0_wi relocations [ 0 ] [ pic n ] 
SWAP_OUT_SIZE(bnd,cam_number , bnd , si zeof ( struct boundary data)); ~ 
20 ) 

it (pic_n =■= 0 | | pic_n == 1) paint_wires_black( 1 image, bnd ,cam_number , cam 
complete_shape ( l_image , bnd , cam_0_wire_locations [pic n] [ 1 ] ) ; 
printf ( "\n" ) ,- " 

dilate_raean ( l_image , l_image_l , bnd , cam_number , cam_0_wi re_l oca t ions , pic_n ) 

else if ( cam_number==CAM 3) 
25 f 

if (pic_n == 0 | I pic_n == 1) paint^_wires_black( 1 image, bnd ,cam_number ,cam 
complete shapefl image , bnd , cam 2 wire locationsrpXc n][0}); 
printf (»\n»); ~ ~ ~ 

complete_shape ( l_image , bnd , cam_2_wire locations [ pic n ] [ 1 ) ) ; 
printf ( "\n") ; " " 

complete_shape ( l_image , bnd , cam_2_wire_locations [ pic_n ] [ 2 ] ) ; 
30 dilate_mean( l_image , l_image_l, bnd, cam_number,cam_2_wire_l oca t ions , pic n) 

else dilate_mean( l_image , l_image_l, bnd, cam number, cam 0 wire locations, pi 

printf ( "\n\n") ; ~ 

return ( SUCCESS ) ; 

} 

int correct_cam_0_bnd ( image , bnd , cam_num, wire_locat ) 

35 struct boundary_data *bnd; 

PIXEL image[FR_Y_SIZE][FR_X_SIZE]; 
int cam_num , wire__locat [ 2 ] ; 

{ 

int i,j,min=255; 
if ( cam_num ! = 0 ) 

40 printf ("\n ERROR : wrong Camera " ) ; 

retum(O); 
) 

for (i=2 ; i<bnd->boundary_index-2 ; i++) 
( 

if ( bnd->boundary[ i] .xl <= wire_locat[l ] ) 

bnd->boundary[i] .xl+=0.8*(wire_locat[13 - bnd->boundary [ i ] . xl + 1) + 0.6 

} 

dilate_raean(scr , dst, bnd, cam_number , wire_locat , pic ) 
struct boundary_data *bnd; 
PIXEL scr[FR_Y_SIZE] [FR_X_SIZE] ; 
PIXEL dst[FR_J¥__SIZE) [FR_X_SIZE] ; 
int wire_locat[ 4 ] [3] [2] ,cam number, pic; 
{ " 
#define NMAX 5 
^define N_MEAN 3 

int 1 ,m, r , i , j ,wire,y ; 

PIXEL *S,*D,*tmp; 

for (i=0; i<FR_Y_SIZE; i++) 
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for (>0; j<FR_X_SIZE; j++) dst[ i ] [ j ]=scr [ i ] [ j J ; 
i f ( camnumber ==CAM_2 ) return ( 0 ) ; 

10 S=&dst[0 J [OJ ; D=&scr[0] [0] ; m-1; 

for (1=0; 1<N_MAX; 1++) 
{ 

tmp=D; D=S; S=trap; 

for (i=0 ; i<bnd->boundary_index; i++) 

for ( y=bnd->boundary[i] .y, j=bnd->boundary [ i ] .xl-1; j<bnd->boundary [ i ] . x 
( 

15 r=y*FR_Y_SIZE + j; 

if ( cam_number == CAM_1 ) 
( 

if (j <= wire_locat[picj [1] [ l]-m £■& j >= wire_locat[pic} [ 1 J [ 0]+m) 
{ 

(*(D+r) )=MAX(*(S + r),MAX(*(S + r+l),*(S + r-1 ) ) ) ; 
if (*(D+r) > 245) *(D+r )=(*(S+r) ) ; 
20 ) 

else *<D+r )=( *(S+r) ) ; 

) 

else 
< 

if ((j <= wire_locat[pic] [0] [ l]-m && j >= wire_locat[pic] [0] [0]+m) II 
(j <= wire_locat[pic] [1] [l]-m && j wire_locat[pic][ 1 ] [ 0]+m) || 
25 (j <= wire_locat[pic](2][l]-m && j >= wire_locat[pic] [ 2 ] [ 0 ]+m) ) 

(*(D+r) )=MAX(*(S + r),MAX(*(S + r+l),*(S + r-1)) ) r ' " 

if (*(D+r) > 245) *(D+r)=(*(S+r) ) ; 

} 

else (*(D+r) )=(*(S+r) ) ; 
> 

30 } 
> 

m=l ; 

for (1=0; 1 <N_MEAN ; 1++) 
{ 

tmp=D; D=S; S=tmp; 

35 for ( i=0 ; i<bnd->boundary_index ; i++) 

for ( y=bnd->boundary[i] .y, j=bnd->boundary [ i ] .xl-1; j<bnd->boundary[ i ] .x 
{ 

r=y*FR_Y_SIZE + j; 
if ( cam_number == CAM_1 ) 
{ 

if (j < wire_locat[pic] [ 1] [1] && j > wire locat[pic] [ 1] [ 0 ] ) 
40 { 

m = (int) (((*(S+r)) + (*(S+r+l)) + (*(S+r-l))) / 3. + 0.5); 

( * ( D+r ) ) = in ; 

) 

else (*(D+r) )=(*(S+r) ) ; 
} 

else 

45 { 

if ((j <= wire_locat[pic] [0] [1} && j >= wire__locat[pic] [ 0j [ 0] ) 
(j <= wire_locat[pic] [ 1 ] [ 1] && j >= wire_locat[pic] [ 1 ] [ 0 ] ) 
(j <= wire_locat{pic] [ 2] [1] && j >= wire_locat[pic] [ 2 ] [ 0 ] ) j 

if (*(S+r+l) > 245 || *(S+r-l) > 245) ( *(D+r ) )=( *(S+r ) ) ; 
else 
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m = (int) (((*(S+r)) + (*(S+r+l)) + (*(S+r-l))) / 3. + 0.5); 

(*(D+r)) = m; 

) 

J 

else (* (D+r) )=(*(S+r) ) ; 
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} 

10 

if (D «= &dst[0] [0] ) 

for (i=0; i<FR_Y_SlZE; i++) 

for (j=0; j<FR_X_SIZE; j++) dst[ i ] [ j ] =scr [ i ] [ j ) ; 

} 

complete_shape ( image , bnd , wire_locat ) 
struct boundary_data *bnd; 
15 PIXEL image [FR_Y_SIZE] [FR_X_SIZE] ; 
int wire_locat[ 2] ; 
{ 

int i, j ,y,r ,old_xl ,old_x2 , oldil ,old_i2 ,Xr , Xl ; 
int xl,x2; 

int inter p_and_pa int (PIXEL [ FR_Y_SIZE ][ FR_XjSIZE ] , int, int , int , int , int) ; 
old_xl=bnd->boundary [ 0 ] . xl ; 
20 old_x2=bnd->boundary [ 0 ] . x2 ; 

old_il=0; 
old_i 2=0 ; 
Xl=wire_locat[ 0 ] ; 
Xr=wire_locat[ 1 ] ; 

for~(i=l ; i<bnd->boundary_index; i++) 

( . 
25 xl= bnd->boundary[ i] .xl; 

x2=* bnd->boundary[ i] .x2 ; 
if (old_xl > XI) ■ 
{ 

if ( xl >= Xr) { old_xl=xl; old_il=i; ) 

if (xl < XI) .... 
{ 

30 printf("\n befor interp_l . . . xr=%d xl=%d old xl=%d xl=%d" ,Xr , XI , ol 

interp_and_paint ( image , XI , Xr , bnd->boundary [ T] . y , bnd->boundary [ old_ 
old_xl=xl; old_il=i ; 
) 

} 

else 
( 

35 if (xl <= XI) { old_xl=xl; old_il=i; } 

if (xl >= Xr) 
( 

printf( M \n befor interp_2 . . . xr=%d xl=%d ",Xr,Xl); 

i nterp_and_paint ( image , Xr , XI , bnd->boundarv r i 1 . v , bnd->boundary [ old_ 
old_xl=xl? old__il=i; 

) 

40 ) 

if (old_x2 < Xr) 
{ 

if ( x2 <= XI) { old_x2=x2; old_i2=i; ) 
if (x2 > Xr) 
< 

printf("\n befor interp_3 . . .xr=%d xl=%d ",Xr,Xl); 
45 interp_and_j5aint( image, Xr, XI, bnd- >boundar-y ( i ) .y,bnd->boiindary[old 

old_x2=x2; old_i2=i; 
) 

} 

else 
{ 

if (x2 >= Xr) { old_x2=x2; old_i2=i; } 
50 if (x2 <= XI) 

{ 

printf("\n befor interp_4 . . . xr=%d xl=%d " ,xr,Xl); 

interp_and_paint( image , XI ,Xr ,bnd->boundary[ i ] .y ,bnd->boundary[old_ 

old_x2=x2; old_i2=i; 

) 
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25 



10 ) 

) 

) 

int interp_and_paint ( img , xl , x2 , yl , y2 , flag ) 
int xl ,X2 ,yl,y2,flag; 

PIXEL img[FR_Y_SI2E][FR_X_SIZE]; 

{ 

it - int d, begin; 

70 double diff x,diff_m; 

printf("\n In interp_. . .xl=%d x2=%d yl=%d y2=%d " , xl , x2 ,yl ,y2 ) ; 
if (yl <= y2) 
{ 

printf("\n ERROR : in complete_shape( ) ; » ) ; 
return ( 0 ) ; 

20 if ((flag == 0 && xl > x2) J| (flag==l && xl < x2 ) ) d=-l ; 

else d=l ; 

diff_x= (xl-x2 ) /(double ) (yl-y2) ; 
begin=img [ y 2+3 *d ] [ x2 ] ; 

diff_m= (img[yl+3*d] [xl] - begin )/(double) (yl-y2 ) ; 
for (i=y2 -1; i <= yl + 1; i++) 
{ 

j=x2 + (int) ( (i-y2-d)*diff_x + 0.5); 
if (flag) 

for (l=j+l ; 1<= MAX(xl,x2)+3; 1++) img[i] [1]=252; 
for (l=MIN(xl+l,x2+l) ; 1< j ; 1++) img£ i ] [ 1]=3 ; 

else 

{ * 
30 for (l=j-l ; 1>= MIN(xl,x2)-3; 1—) img[ i ] [ 1 ]=252 ; 

for (l=MAX(xl-l,x2-l) ; 1> j? 1—) img[ i ] [ 1]=3 ; 
) 

img [i][j] — ( PIXEL ) (begin + ( int ) ( ( i-y2-d ) *dif f _ra +0.5)); 

printf("\n INTERP : %d , y=%d x=%d beg=%d dif f =%f » f img[ i ] [ j] , i , j , begin ,di 

} 

) 

35 pa int_wires_black( image ,bnd , cam_number , wire_locat , pic ) 
struct boundary_data *bnd; 
PIXEL image[FR_Y_SIZE] [FR_X_SIZE] ; 
int wire_locat [ 4 ] [ 3 ] [ 2 ] , cam_number , pic ; 

t 

int i, j,Rl,R2,R3,Ll,L2,L3,mid,diff ; 
if (cam_number =CAM 2) retum(O); 

mid = (wire_locat[pic][l][l] + wire_locat[pic ] [ 1] [0] ) » 1; 
40 diff = (wire_locat[pic][l][l] - wire_locat[pic] [ 1 ] [ 0 ] ) » 1; 

Rl=MAX(wire_locat[pic] [1][0] +1, mid-N_MAX+l ) ? 
Ll=MIN(wire_locat[pic] [1] [1] -1 ,mid+N_MAX ) ; 
printf("\n PR=%d PL=%d" ,R1 ,L1 ) ? 
for (i=0; i<FR_Y_SIZE; i++) 
for (j=Ri; j<= Ll; j++) 
{ 

45 image[i][ j]=l; 

) 

if ( cam_number =-CAM_3 ) 
{ 

mid = (wire locat[pic] [ 0] [ l ] + wire_locat[pic] [ 0 ] [0 ] ) >> l; 
R2=MAX(wire_Tocat [pic ] [0][0] + 1 ,mid-N__MAX+l ) ; 
L2=MIN( wire_locat [ pic ] [ 0 ] [ 1 ] -1 , mid+N_MAX ) ; 

mid - (wire_locat[pic] [ 2] [1] + wire_locat [pic] [ 2 ] [ 0 ) } » l; 
50 R3=MAX(wire_locat[pic][2][0] +1 , mid-N_MAX+l ) ; 

L3=MlN(wire_locat[pic] [2] [ 1} -1 ,mid+N_MAX ) ; 
for (i=0; i<FR_Y_SIZE; i++) 
for (j=R2; j<= L2 ; j++) 
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( 

10 image[i][ j]=l; 

> 

for (i=0; i<FR_Y_SIZE; i++ ) 
for (j=R3? j<= L3; 
{ 

image[i][j]=l; 
) 

15 > 

) 

clear_x_sel ( image , boundary , boundary_index ) 
PIXEL image [ ] [FR_X_SIZE] ; 
struct line_pair boundary[]; 

{ 

int i,j,y,xl,x2; 

for (y = 0 ; y < boundary [ 0 ). y ; ++y) 
20 for (j = 0 ; j < FR_X_SIZE ; ++j) image[y][j] = 0; 

for (i = 0 ; i < boundary_index ; ++i) 
( 

y = boundary[ i ] .y; 
xl - boundary^ i ] -xl; 
x2 = boundary [ i ] .x2; 

for (j = o ; j < xl ; ++j) image [y](j] = 0.; 

25 for (j = x2 ; j < FR_X_SIZE ; image[y][j] = 0; 

> 

for (y = boundary [ boundary_index-l ] .y+1 ; y < FR_YSIZE ; ++y) 
for (j = 0 ; j < FR_X_SIZE ; ++ j ) image [y][j] = 0; 
} * * 

clear_x_sel_color( image, boundary , boundary_index , color) 
PIXEL image [ ] [FR_X_SIZEJ ; 
3q struct linepair boundary[]; 

int i, j,y,xl,x2; 

for (y ~ 0 ; y < boundary r 0} .y ; ++y) 

for (j = 0 ; j < FR_X_SIZE ; ++j) image ( y ][ j J = color; 
for (i = 0 ; i < boundary_index ; ++i) 
< 

y = boundary [ i ] .y; 
xl = boundary [ i ] .xl; 
x2 « boundary [ i ]. x2 ; 

for (j « o ; j < xl ; ++ j ) image[y}[j] = color; 

for ( j = x2 ; j < FR_X_SIZE 7 ++j) image[yl[j] = color? 

) 

for (y = boundary [boundary_index-l ] .y+l ; y < FR_Y_SIZE ; ++y) 
for (j ■ 0 ; j < FR_X_SIZE ; ++j) image[y][j] = color; 

40 ) 

correct_pip_hole_n( image , boundary, boundary_index , off_x, off_y) 
PIXEL image [ L_FR_Y_SIZE ] [ L_FR_X_SIZE ] ; 
struct line_pair boundary [ ] ; 

{ 

int i, y f xl, yi, j, x2; 
#def ine MARGIN 4 
45 for (i = 0 ; i < boundary_index ; ++i) 

y - boundary [ i ] . y - of f _y ; 
if (y < 0 | j y >= L_FR_Y_SIZE) continue; 

xl = boundary [ i] .xl - off_x + MARGIN; if (xl < 0) xl = 0; 

x2 = boundary[i] .x2 - off_x - MARGIN; if (x2 > L_FR X SIZE) x2 = L FR X SIZ 
if (Xl == 0 && X2 == L_FR_X_SIZE) ~ 
for (j = 0 ; j < x2 ; image[y][j] = 255; 

else { 

for (j » 0 ; j < xl ; ++j) image [ y ][ j ] = 255; 

for (j = X2 ; j < L_FR_X_SIZE ; -h+j) image[y][j] = 255; 

) 
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for (y = 0 ; y < boundary [ 0 ]. y - off y ; ++y) 
10 for (j = 0 ; j < L_FR_ > _X_SIZE ; ++3) 

Tmage[y][j] = 255; 
for (y = boundary[boundary_index-l] .y - off_y ; y < L_FR_Y_SIZE ; ++y ) 
for (j = 0 ; j < L_FR X_SIZE ; ++j) 

Tmage[y][j] = 255; 

Sundef MARGIN 

15 clear outside ( image , boundary, boundary_index , color) 

PIXEL image [ FR_Y_SIZE ] [ FR_X_SI ZE ] ; 
struct line_pair boundary[]; 

{ 

int i f y, xl, yl, j, x2; 
#define MARGIN 0 

for ( i = 0 ; i < boundary_index ; ++i ) 
20 { 

y = boundary [i] . y; 
if (y < 0 || y >= L_FR_Y_SIZE) continue; 
xl = boundary [i] .xl + MARGIN; if (xl < 0) xl = 0; 

x2 = boundaryfi] -x2 - MARGIN; if (x2 > FR_X_SIZE) x2 « FR_X_SIZE; 
if (xl == 0 && x2 FR_X_SIZE) 

for (j =0 ; j < x2 ; ++j) image[y][j] = color; 

25 else { 

for (j = 0 ; j < xl ; ++j) image [ y ][ j ] color; 

for ( j = x2 ; j < FR_X_SIZE ; ++j) imagery] [j] = color; 

) 

} . 
for (y ~ 0 ; y < boundary [ 0 ]. y ; ++y) 
for (j = 0 ; j < FR_X SIZE ; ++j) 
30 image[y]Ij] = color; 

for (y = boundary [bo undary_index-l ] .y ; y < FR_Y_SIZE ; ++y) 
for ( j = 0 ; j < FR_X_SIZE ; ++j) 

iroage [ y } [ j ] = color; 

tfundef MARGIN 
} 

do_smooth_masked { src , ds t ) 
35 PIXEL src[ ) [FR_X_SIZE] ; 

PIXEL dst[ ] [ FR_X_SIZE] ; 

{ 

int i,j, cnt; 
unsigned int n, p; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 
for (j = 1 ; j < FR_X_SIZE-1 ; ++ j ) 

40 { . . 

P - src[i][3]; 

if <p < 253) { n - p « 2; cnt =4; ) 

else { dst[i][j] = ( PIXEL ) p ; continue; } 
^define ADD_C0ND4 ( a , b ) p « src[a][b]; if (p < 253) {n += (p « l); cnt +=2;} 
#define ADD_COND8 ( a , b ) p = src[aj[b]; if (p < 253) (n += p; cnt +=» 1 ; ) 

ADD_COND4(i, j-1) ; 

ADD_COND4 ( i-1 , j ) ; 
45 ADD_COND4 ( i+1 , j ) ; 

ADD_COND4 ( i , j+1 ) ; 

ADD_COND8 ( i-1 , j-1 ) ; 

ADD_COND8 ( i-1 , j+1 ) ; 

ADD_COND8 ( i + 1 , j-1 ) ; 

ADD_COND8 ( i+1 , j+1 ) ; 

n = (int) ( (double )n / (double) cnt + 0.5); 
50 dst[i][j] = (PIXEL)n; 

) 

return ( 1 ) ; 

) 

static 
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10 f ill_margins( im2 ) 

PIXEL ira2 [ ) [ FR_X_S I ZE ] ; 

i 

int i,j; 

for (i = 0 ; i < FR_Y_SIZE ; ++i ) 
< 

im2[i][0) = im2[i][lj; 

im2[ij [FR_X_SIZE-1] = im2[ i ] [FR_X_SIZE-2] ; 

J 

for (j = 1 ; j < FR_X_SIZE-1 ; ++i ) 
{ 

im2[0][j] = im2[l][j]; 

im2[FR_Y_SIZE-l)[ j] = im2[ FR_Y_SIZE-2 ] [ j ] ; 

> 

> 

do_sobel(iml,im2) PIXEL iralfj-FR X_S2iE3; 

PIXEL im2[ ][FR_X_SIZE); 
{ 

int i , j ,gl # g2 ,h,v,n; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i ) 
for (j - 1 ; j < FR_X_SIZE-1 ; ++j) 
( 

gl = iml[i-l)[ + iml[i-l][ gl += (iml[ i-1 J [ j ] « 1); 

25 g2 = imi[i+i]( j-l) + imlf i+l ] [ ; g2 += ( iml[ i+l] [ j ] « 1); 

h - gl - g2; 
if (h < 0) h = -h; 

gl - iml [ i-1 ][ j-l) + iml[i+l)f j-l]; gl += ( iml[ i ] [ j-l) « 1); 
g2 = imlf i-l]( j+1] + imlC i+l] [ ? 92 += ( iml[ i ] [ j+1] « 1); 
v = gl - g2; 
if (v < 0) v = -v; 
30 n = (v + h) : 

n = n » 2; 
if (n > 255) n = 255; 
im2[i][j) = (PIXEL)n; 

} 

f ill_margins ( iiu2 ) ; 
return ( 1 ) ; 

) 

35 do_stretch(iml,im2,delta) PIXEL iml [ ] [ FR_X_SIZE) ; 

PIXEL im2[ ] [FR_X_SIZE] ; 

( 

int i,j; 

int rain = 256, max = -1, pix; 
double factor; 

for (i = delta ; i < FR_Y_SIZE-delta ; ++i) 
„ for (j = delta ; j < FRXSIZE-delta ; ++j) 

t 

pix = (int) iral[i)[j]; 
if (pix > max) max = pix; 
if (pix < rain) min = pix; 
) 

factor = 255. /(double ) (max - min); 
for (i = delta ; i < FR_Y_SIZE-delta ; ++i) 
45 for (j = delta ; j < FRXSIZE-delta ; ++j) 

< 

pix = (int) iral[i][j); 

pix = (int) ((double) (pix - min) * factor +0.5) ; 
im2fi][j] = (PIXEL) pix; 

) 

) 

do_sharpening( iml , im2 ) PIXEL iml [ ] [ FR_X_SIZE ] ; 

PIXEL im2[ ] [FR_X_SIZE] ; 

{ 

int i, j,n; 
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int min,max; 

for (i - 1 ; i < fr_y_SIZE-1 ; ++i) 
10 for (j = 1 ; j < FR_X_SIZE-1 ? ++j) 

{ 

n = n - + iml[ i ] [ j-i] + imi[i+l][j] + iml[i] [ j+l] ) ; 

n = n » 4; 
if (n > 255) n = 255; 
15 else if (n < 0) n = o; 

im2[i][j] = n; 

} 

f ill_margins( im2 ) ; 

do_stretch( im2 , in2 , 5 ) ; 

do smooth <iml,im2) PIXEL iml[ ] L FR_X_SIZE) ; 

20 ~ PIXEL im2[ ] [FR_X_J5IZE] ; 

{ 

int. i , j ; 
unsigned int n ; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 
for (j = l ; j < FR_X_SIZE-1 ; ++j) 
{ ~ . 

25 n - iml[i][j3 « 2; 

n += 

( (iml[i][ + iml[i-l][j] + iml[i+l][j] + iml [ i ] [ j+l ] ) « 1); 

n iml[i-l][ + iml[i-l)[ j+l] + iml[ i+1 ] [ j-1 ] + iml[ i+1] [* j+"l ] ; 

n = n » 4; 
im2[i][j) - (PIXEL)n; 

30 > 

f ill_margins ( im2 ) ; 
return ( 1 ) ; 

) 

do_erosion_0( iml, im2 , color) PIXEL iml[ ] [FR_X_SIZE] ; 

PIXEL im2[ ] [FR_X_SIZE] ; 

{ 

35 int i,j,n, 1, c4 = color « 2, fr; 

1 = 0; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 
for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 
< 

fr = 0; 

if (iml[i][j] == color) 

40 t 

n = iinl[i-l] [ j) + imi[ i+l) [ 3] + 

iral(i][ j+l) + iml[i][j-l] 

if (n == c4) { fr = color; 1=1; } 

) 

im2[i][j] = fr; 

} 

^5 return ( 1 ) ; 

do dialation 0 ( iml , ira2 , color ) PIXEL iml[] [FR_X_SIZE] ; 

PIXEL im2 [ ] [ FR_X_SIZE ] ; 

{ 

int i , j , n , 1 ; 
1 = 0; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i ) 
for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 
{ 

im2[i][j) - iml[i][j]; 
if (iml[i][j] ! = color) 

< 
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f „ n = imlCi-l][ j] + iml[i+l][j] + 

iml[i][j+l] + iml[i][j-l] 
if (n) { im2[i][j] - color; 1=1; } 
> 
) 

f ill_margins(im2) ; 
return(l) ; 

15 do dialati on (iral,im2, color) PIXEL iml[ ] [FR_X_SIZE] ; 

PIXEL im2[][FR_X_SIZE]; 

< 

int i,j,n, 1; 
1-0; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 
for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 
20 ( 

ira2[i)[j] = imi[i]C3]? 
if ( iml[i][ j] J = color) 

( 

if (irol[ i-1] [ j] «= color) goto cont; 
if (iml[ i+1] [ j] == color) goto cont; 
if (iml[i][j+l) == color) goto cont; 
if (imlfi] [j-1] color) goto cont; 
25 im2[i][j] = iml[i][j]; 

continue; 
cont : 

im2[i][j) = color; 1 = 1; 

) 

) 

f ill_margins(im2 ) ; 
30 return(l); 
) 

do_erosion(iml,im2, color) PIXEL inil[ ] [FR_X_SIZE] ; 

PIXEL im2 [ ) [ FR_X_S1 ZE ] ; 

{ 

int i , j , n , 1 ; 
1 = 0; 

35 for (i = 1 ; i < FR_Y_SIZE-1 ; ++i ) 

for (j = 1 ; j < FR_X_SIZE-1 ; 

{ 

if (imlfi Hi] ! = color) im2Ci][j] = iml[i][j] ; 
else { 
n = 0; 

if <iml[i-l] [ j ] == color) ++n; 
if (iml[i+l) [ j ) == color) ++n; 
40 if ( iml[i j [ j-f 1 ) — color) ++n; 

if (iml[i] [ j-1] == color) ++n; 

if (n < 4) im2[i][j] - o ; else { ira2[i][j] = color; 1=1; } 

) 

> 

f ill_raargins( im2) ; 
re turn (1 ) ; 

45 ) 

static 

order_it(vec) int vec[9]; 

( 

int i , j 7 
int order_flag ; 
do 

( 

order flag = 0 ; 
for (1=1 ; i < 9 ; ++i) 
if (vecCi-l] > vec[i)) 
< 
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j = vec[i-l] ; 
vec[i-l] = vec[i] ; 
vec[i) = j ; 
order_flag = l ; 

> 

) while ( order_flag ) ; 

) 

do_median( iml,im2) 

PIXEL imlf ] [FR_X_SIZE] ; 
PIXEL im2[ ] [ FR_X_SIZE] ; 

< 

int i,j,k; 
int mm[ 9 ] ; 

for (i = 1 ; 
for (j - l i 



J 2 3 



FR_Y_SIZE-1 j 
< FR X SIZE-1 



{ 



ixnl[i+l][ j); 
iml[i][ 

iml[i-l][ j+1); 
iml[i+l] [ j+1] ; 



mm[l] = iml[ i-l ] [ j] ; 

nun[3] = iml[i] [ j-l] ; 

mra[5] = iml[i-l] [ j-l] ; 

mni[7] = iml[i+l] [ j-l] ; 



mm[ 0 ] 
mm[ 2] 
mra[4 ] 
mm[ 6 ] 
mm[ 8 ] 

order_it(mm) ; 
k = mm[ 4 ] ; 
im2[i][j] = k; 
) 

f ill_margins(im2 ) ; 

} 

smooth_screen(xl ,yl ,x2 ,y2,x_of f_l , y_off_l, x_off_2, y off 2) 
( 

int x,y,i,j,l = x2-xl , n; 
unsigned char *ar; 

ar » malloc(l*3); 

if (ar == 0) { printf 

for (i = yl ; i < y2 
{ 

get_block( ar , 0, 0 
for ( j = 1+2 ; j < 



( "\n No MEM" ) ; 



exit(l); ) 



{ 



« (*(ar 
= (*(ar 
- (*(ar 
= (*(ar 

n « 1; 

((Mar 



0 , 3 , 
< 1+1 

D) ; 

D) ' 

i) ) ; 

i) ) ; 



xl + x_off 1, i+l+ y off 1); 
f+j) " " - 



+ j)) « 2); 



+= 



n 

n += 
n += 
n += 
n += 



x; 

(*(ar + 
(*(ar + 
(*(ar + 
(*{ar + 
= n >> 4 ; 
*(ar+j-2) = n 



D); 
D); 
D); 



} 

copy__block< ar+1 , 

) 

free far) ; 

) 

image_max ( image ) 
{ 

int i , j , max ; 
max = 0 ; 
for (i = 0 
for (j 



0,0, 1 , l,xl+2+x_of f_2,i+l+y_off_2) ; 



PIXEL image [ ] [FR_X_SIZE] ; 



< FR_Y_SIZE ; ++i) 
; j < FR_X_SIZE ; ++j) 
if (image[i][j] > max) max = imager i ][ j ] ; 
printf ("\n max = %d",niax); 
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return (max) ; 

) 

dialate_color (mat , matl, color) 
PIXEL mat[ ] [FR_X_SIZE] ; 
PIXEL matl[ ] [ FR_X_SIZE] ; 

{ 

int i , j , count - 0 ; 

for (i = 1 ; i < FR_Y_SIZE-1 ; ++i) 

for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 

if (raat[i-l][ j] = color I mat[i3[j-l] == color || 
mat[i+l][j] == color || mat[i][j-fl] = color) 
{ raatl[i][j] = color; ++count; J 
else matl[i](j] = mat[i][j]; 

return ( count ) ; 

) 

erode_color(mat, matl, color) 
20 PIXEL mat[ } [FR_X_SIZE] ; 

PIXEL matl[ ] [ FR_X_S I Z E ] ; 

{ 

int i , j , count = 0 ; 
. for (i « 1 ; i < FR_Y_SIZE-1 ; ++i) 

for (j = 1 ; j < FR_X_SIZE-1 ; ++j) 

if (mat[i-l][j] != color I mat[i][j-l] != color || 
25 mat[i+l][jj i= color || mat[i][j+l] != color) 

{ matl[i][j] = 0; } 
else ( matl[i][j] = mat[i][j]; ++count; ) 

return ( count ) ; 

) 

static int x_resolution, y_resolution; 
static int x_pos, y_pos , init_status; 
30 vga_null( ) {) 

vga_clear_screen ( color ) 
{ 

int y; 

unsigned char c; 

vga_f illed_rec tangle (0,0, x_resolution , y_resolution , color) ; 
Sifdef BIOSCLS 
35 c = color; 

_asm \ 
{ 

mov ah , Obh 

mov bh, 00 

mov bl , c 

int lOh 
40 n °P 

*endif 
) 

in it_vga_di splay ( mode ) 
{ 

int i ; 

unsigned short lut[256][4]; 
switch (mode) 



) 



case 5: 

bios_vga_mode ( 0x5d ) ; 
x_resolution = 640; 
y_resolution = 480; 
break ; 

for (i = 0 ; i < 256 ; ++i ) 
t 

lut[i][0] = i; 
lut[i][l] = i; 
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J Z:> 

lut[i][2] = i; 
10 lut[i][3] = 255; 

) 

vga_set_pallate ( lut ) ; 
init_status = 1; 

) 

reinit_vga( ) 
{ 

15 x_resolution = 640; 

y^resolution = 480; 
init_status =2; 

) 

vga_f illed_rectangle(xl ,yl ,x2 , y2 , color ) 
f 

for ( ; yl <= y2 ; ++yl ) 

vga_hline(xl , yl, (x2-xl+l), color;; 

} 

vga_rectangle(xl , yl ,x2 ,y2 , color ) 
{ 

vga_hline(xl , yl , (x2-xl+l), color); 
vga_hline(xl , y2, (x2-xl+l), color); 
vga_vline(xl , yl , (y2-yl+l), color); 
vga vline(x2, yl , (y2-yl+l), color); 

25 > 

vga_vline(xdst , ydst, len, color) 
{ 

int i , j ; . 
unsigned short a_h, a_l ; 
unsigned long address; 

address = (unsigned long) ydst * x_resolution + (unsigned long)xdst; 
30 for (i = 0 ; i < len ; ++i ) 

{ 

a_l = address & OxFFFF; 

a_h = (address >> 16) & OxF; 

address += x resolution; 

_asm 
mo 

35 



_asm ( 






mov 


bh, 


a h 


inov 


di, 


a 1 


mov 


ax , 


OAOOOh 


mov 


es , 


ax 


mov 


ah, 


bh 


xor 


ah , 


2 


mov 


dx, 


3c4h 


mov 


al, 


OEh 


out 


dx, 


ax 


mov 


al, 


color 


stosb 







40 

) 

} 

) 

vga_hline(xdst , ydst, len, color) 

45 int i,j; 

unsigned short a_h, a_l; 
unsigned long address; 

address = (unsigned long) ydst * x resolution + (unsigned long)xdst; 

for (i = 0 ; i < len ; ++i) 

< 

a_l = address & OxFFFF; 
50 a_h = (address » 16) & OxF; 

address += 1; 
_asra { 

mov bh , a_h 
mov di , a_l 
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mov 


ax , 


OAOOOh 


nov 


es , 


ax 


mov 


ah, 


bh 


xor 


ah, 


2 


mov 


dx, 


3G4h 


mov 


al, 


OEh 


out 


dx, 


ax 


mov 


al, 


color 


stosb 







} 

} 

vga put image ( image , ximage, yimage, xdst, ydst) 
~ *"* unsigned char * image ; 

{ 

20 int i , j ; 

unsigned short a_h, a_l ; 
unsigned long address; 
unsigned char color; 

address = (unsigned long) ydst * x_resolution + (unsigned long ) xdst; 

for (i = 0 ; i < yimage ; ++i) 

{ 

for (j = 0 ; j < ximage ; 
25 ( 

a_l = address & OxFFFF; 
a_h « (address » 16) & OxF; 



35 



color = 


* image++ ; 


address 


+= 1; 


asm { 






mov 


bh. 


a h 


mov 


di, 


a 1 


mov 


ax, 


OAOOOh 


mov 


es, 


ax 


mov 


ah, 


bh 


xor 


ah. 


2 


mov 


dx, 


3c4h 


mov 


al, 


OEh 


out 


dx, 


ax 


mov 


al. 


color 


stosb 







} 

} 

address += (x_resolution - ximage); 

} 

} 

40 vga_get_image ( image , ximage, yimage, xdst, ydst) 

unsigned char *image; 

{ 

int i,j; 

unsigned short a_h, a_l ; 
unsigned long address; 
unsigned char color; 
45 address = (unsigned long) ydst * x_resolution +■ (unsigned long) xdst; 

for (i = 0 ; i < yimage ; ++i) 

{ 

for (j = 0 ; j < ximage ; ++j) 
{ 

a_l = address & OxFFFF ; 

a_h = (address >> 16) & OxF; 



push si 
mov bh , a_h 
mov si , a_l 
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mov ah, bh 
10 xor ah, 2 

mov dx, 3c 4h 
mov al , OEh 
out dx , ax 
mov ax, OAOOOh 
mov ds , ax 
lodsb 

15 pop s i 

pop ds 
mov color, al 
} 

*image++ ** color; 
address +- 1 ; 

20 address += (x__re solution - ximage); 

} 

vga_set_pallate( lut ) unsigned short *lut; 

< 

unsigned short a_l, a_h; 
unsigned long v; 

25 int 17 

*° unsigned char *p = (unsigned char *)lut; 
for (i = 0 ; i < 256*4 ; i += 4 ) 
{ 

*p++ = lut[ij » 2; 
*p++ = lut[i+l] » 2; 
*p++ = lut[i+2] » 2; 

J 

30 v = (unsigned long ) lut; 

a_l = v & OxFFFF; 
v = v » 16; 
ah = v & OxFFFF ; 
_asm \ 
{ 

mov es , a_h 

35 mov dx , a_l 

mov ah, lOh 

mov al, 12h 

mov bx , 0 

mov cx , 256 

int lOh 
nop 

) 

) 

vga_set_l_cval (value , r,g,b) 
( 

__asm \ 
{ 

45 



40 



mov 


ah, lOh 


mov 


al, lOh 


mov 


bx, value 


mov 


dh, r 


mov 


ch, g 


mov 


cl, b 


int 


lOh 


nop 





} 

50 } 

vga_direct_r pixel ( x , y ) 
{ 

unsigned char color; 
unsigned long address; 
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unsigned short a_h, a_l; 

address = (unsigned long)y * x_resolution + (unsigned long) 
a_l = address & OxFFFF; 
address = address » 16; 
a_h = address & OxF; 
jsm { 



push 


ds 




push 


si 




mov 


bh, 


a h 


mov 


si, 


a 1 


mov 


ah, 


bh 


xor 


ah, 


2 


mov 


dx, 


3c4h 


mov 


al, 


OEh 


out 


dx, 


ax 


mov 


ax, 


OAOOOh 


mov 


ds, 


ax 


lodsb 






pop 


si 




pop 


ds 




mov 


color, al 



> 

return ( color ) ; 

) 

vga_direct_wpixel ( x , y , color ) 
{ 

unsigned short ah, a_l; 
unsigned long address ; 

address = (unsigned long)y * x_resolution + (unsigned long)x 

al = address & OxFFFF; 

address = address >> 16; 

a h = address & OxF; 



asm ( 






mov 


bh, 


a h 


mov 


di, 


a_l 


mov 


bl 


, color 


mov 


ax, 


OAOOOh 


mov 


es , 


ax 


mov 


ah, 


bh 


xor 


ah. 


2 


mov 


dx, 


3c4h 


mov 


al, 


OEh 


out 


dx, 


ax 


mov 


al, 


bl 


stosb 







} 

} 

bios_vga_mode (mode ) 
{ 

unsigned char ml = mode & Oxff ; 



asm \ 
{ 



int 
nop 



mov 



mov 



ah, OOh 

al , ml 
lOh 



; SELECT 64K mode 



mov 

mov 

out 

inc 

in 

mov 

mov 



dx, 3C4h 
al, OBh 
dx, al 



dx 

al, dx 



dx, 3CEh 
ax, 506h 
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5 



out dx, ax 

10 > 

) 

restore_vga( ) 
< 

unsigned char ml = 0x3; 
if (init_status == 1) 
{ 

15 _asm \ 

inov ah , OOh 

mov al, ml 

int lOh 
nop 

> 

20 , ' 

bios_vga_stat( ) 
{ 

unsigned char disp_mode; 
unsigned char chars_in_line ; 
unsigned char err; 
asm \ 
25 { 

mov ah, OFh 

int lOh 

mov disp_mode, al 

mov chars_in_line, ah 

} 

printf( M \n %d %d", disp_mode, chars_in_line ) ; 

30 ) 

etext_vga ( x , y , string , hvf lag , color , magnification ) 
int x f y , hvf lag , magnification , color; 
char string[ ] ; 

( 

int index, size; 

size = magnification * 8; 
3S for (index = 0 ; string [ index] ; ++index) 

{ 

vga_single_char_l ( string [ index ] , x , y , magnification , color ) 
if (hvf lag) x +- size; 
else y += size; 

) 

} 

vga_single_char_l ( ascii , x , y , magnification , color ) 

int table_index = ascii - 040; 
int row, col, bits, old_x » x; 
int row_l, col_l; 

if (table_index < 0 || table_index > 200) return(O); 

for (row = 0 ; row < 9 ; ++row) 

( 

45 bits - demi ( table_index , row) ; 

x = old_x; 

for (col = o ; col < 8 ; ++col ) 
( 

if (bits & 0x80) { 
for (row_l = y ; row_l < y + magnification; ++row_l ) 
for (col_i = x ; col_l < x + magnification; ++col_l ) 
50 ^ vga_direct_wpixel( col_l 7 row_i, color); 

else { 
} 

bits = bits << l; 
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x += magnification ; 

) 

y += magnification ; 

) 

} 

# include <math.h> 

^define RASTER_SIZE_X x_resolution 

£ define RASTER_SIZE_Y y_resolution 

$ define putpix_y vga_direct_wpixel 

static 

put_dot(x,y , color) 

int x,y ; 

{ 

if (x > RASTERSIZEX ( | y > RASTER_SIZE_Y | j x < 0 j | y < 0 > 

return ( 0 ) ; 
) 

else 
{ 

putpix_v(x,y, color) ; 

return ( 1 ) ; 

) 

) 

unsigned char char_table[ ] [ 10] = { 

{ 0000, 0000, 0000, 0000, 0000, 0000, 0000, 0000, 0000, 0000 }, 
( 0020, 0020, 0020, 0020, 0020, 0000, 0020, 0000, 0000, 0000 ), 
{ 0120, 0120, 0120, 0000, 0000, 0000, 0000, 0000, 0000, 0000 ), 
{ 0120, 0120, 0370, 0120, 0370, 0120, 0120, 0000, 0000, 0000 }, 
{ 0040, 0170, 0240, 0160, 0050, 0360, 0040, 0000, 0000, 0000 ), 
{ 0300, 0310, 0020, 0040, 0100, 0230, 0030, 0000, 0000, 0000 }, 
{ 0100, 0240, 0240, 0100, 0250, 0220, 0150, 0000, 0000, 0000 }, 
{ 0040, 0040, 0040, 0000, 0000, 0000, 0000, 0000, 0000, 0000 ), 
{ 0040, 0100, 0200, 0200, 0200, 0100, 0040, 0000, 0000, 0000 ), 
{ 0O4O, 0020, 0010, 0010, 0010, 0020, 0040, 0000, 0000, 0000 ), 
{ 0040, 0250, 0160, 0040, 0160, 0250, 0040, 0000, 0000, 0000 ), 
{ 0000, 0040, 0040, 0370, 0040, 0040, 0000, 0000, 0000, 0000 ), 
{ 0000, 0000, 0000, 0000, 0040, 0040, 0100, 0000, 0000, 0000 ), 
{ 0000, 0000, 0000, 0370, 0000, 0000, 0000, 0000, 0000, 0000 ), 
{ 0000, 0000, 0000, 0000, 0000, 0000, 0040, 0000, 0000, 0000 }, 
{ 0000, 0010, 0020, 0040, 0100, 0200, 0000, 0000, 0000, 0000 }, 
{ 0160, 0210, 0230, 0250, 0310, 0210, 0160, 0000, 0000, 0000 ), 
{ 0040, 0140, 0040, 0040, 0040, 0040, 0160, 0000, 0000, 0000 ), 
{ 0160, 0210, 0010, 0060, 0100, 0200, 0370, 0000, 0000, 0000 ), 
{ 0370, 0010, 0020, 0060, 0010, 0210, 0160, 0000, 0000, 0000 ), 
{ 0020, 0060, 0120, 0220, 0370, 0020, 0020, 0000, 0000, 0000 ), 
{ 0370, 0200, 0360, 0010, 0010, 0010, 0360, 0000, 0000, 0000 ), 
( 0160, 0200, 0200, 0360, 0210, 0210, 0160, 0000, 0000, 0000 ), 
{ 0370, 0010, 0020, 0040, 0100, 0100, 0100, 0000, 0000, 0000 }] 
{ 0160, 0210, 0210, 0160, 0210, 0210, 0160, 0000, 0000, 0000 ), 
{ 0160, 0210, 0210, 0170, 0010, 0010, 0160, 0000, 0000, 0000 }, 
{ 0000, 0000, 0040, 0000, 0040, 0000, 0000, 0000, 0000, 0000 ), 
( 0000, 0000, 0040, 0000, 0040, 0040, 0100, 0000, 0000, 0000 )', 
{ 0020, 0040, 0100, 0200, 0100, 0040, 0020, 0000, 0000, 0000 }\ 
{ 0000, 0000, 0370, 0000, 0370, 0000, 0000, 0000, 0000, 0000 }' 
{ 0200, 0100, 0040, 0020, 0040, 0100, 0200, 0000, 0000, 0000 }' 
{ 0160, 0210, 0020, 0040, 0040, 0000, 0040, 0000, 0000, 0000 )', 
{ 0160, 0210, 0250, 0270, 0260, 0200, 0170, 0000, 0000, 0000 )' 
{ 0040, 0120, 0210, 0210, 0370, 0210, 0210, 0000, 0000, 0000 ), 
{ 0360, 0210, 0210, 0360, 0210, 0210, 0360, 0000, 0000, 0000 ), 
{ 0160, 0210, 0200, 0200, 0200, 0210, 0160, 0000, 0000, 0000 ), 
{ 0360, 0210, 0210, 0210, 0210, 0210, 0360, 0000, 0000, 0000 >' 
{ 0370, 0200, 0200, 0360, 0200, 0200, 0370, 0000, 0000, 0000 )', 
{ 0370, 0200, 0200, 0360, 0200, 0200, 0200, 0000, 0000, 0000 }\ 
{ 0170, 0200, 0200, 0200, 0230, 0210, 0170, 0000, 0000, 0000 ), 
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10 



15 



20 



25 



30 



35 



40 



45 



50 



( 0210, 0210, 0210, 

{ 0160, 0040, 0040, 

{ 0010, 0010, 0010, 

{ 0210, 0220, 0240, 



0370, 0210 

0040, 0040 

0010, 0010 

0300, 0240 

{ 0200, 0200, 0200, 0200, 0200, 0200, 0370, 

{ 0210, 0330, 0250, 0210, 0210, 0210, 0210, 

{ 0210, 0210, 0310, 0250, 0230, 0210, 0210, 

{ 0160, 0210, 0210, 0210, 0210, 0210, 0160, 
{ 0360, 0210, 0210 
{ 0160, 0210, 0210 
{ 0360, 0210, 0210, 0360 



0210, 0210, 

0040, 0160, 

0210, 0160, 

0220, 0210, 



{ 0160, 021O, 0200, 

( 0370, 0040, 0040, 

( 0210, 0210, 0210, 

{ 0210, 0210, 0210, 

( 0210, 0210, 0210 i 

{ 0210, 0210, 0120, 



0360, 0200, 0200, 0200, 

0210, 0250, 0220, 0150, 

0240, 0220, 0210, 

0160, 0010, 0210, 0160, 

0040, 0040, 0040, 0040, 

0210, 0210, 0210, 0160, 

0210, 0210, 0120, 0040, 

0250, 0250, 0330, 0210, 

0040, 0120, 0210, 0210, 



{ 0210, 

{ 0370, 

{ 0370, 

{ 0000, 

{ 0370, 



0210, 0120, 0040, 0040, 0040, 0040, 



0010, 
0300, 
0200, 
0030, 



0020, 



{ 0000, 0000, 0040, 



0210, 0230, 0150, 
0210, 0310, 0260, 
0200, 0170, 
0230, 0150, 
0200, 0160, 



0200 
0210 



0040, 0100, 0200, 0370 
0300, 0300, 0300, 0300, 0370, 
0100, 0040, 0020, 0010, 00OO, 
0030, 0030, ( 0030, 0030, 0370, 
0120,' 0210, 0000, 0000, 
{ 0000, 0000, 0000, 0000, 0000, OOOO, 0370, 
{ 0100, 0040, 0020, 0000, 0000, 0000, 0000, 
{ 0000, 0000, 0150, 0230 
{ 0200, 0200, 0260, 0310 
( 0000, 0000, 0170, 0200 
{ 0010, 0010, 0150, 0230 
{ 0000, 0000, 0160/ 0210, 0370 
{ 0020, 0040, 0040, 0160, 0040, 0040, 0040 
( 0000, 0000, 0150, 0230, 0210, 0230, 0150 
{ 0200, 0200, 0260, 0310, 0210, 0210, 0210 
{ 0040, 0000, 0140, 0040, 0040, 0040, 0160 
{ 0020, 0000, 0020, 0020, 0020, 0020, 002O 
{ 0200, 0210, 0220, 0240, 0340, 0220, 0210 
{ 0140, 0040, 0040, 0040, 0040, 0040, 0160 
{ 0000, 0000, 0320, 0250, O250 , 0250, 0250 
{ 0000, 0000, 0360, 0210, 0210, 0210, 0210 
< 0000, 0000, 0160, 0210, 0210, 0210, 0160 
{ 0000, 0000, 0260, 0310, 0210, 0310, 0260 
{ 0000, 0000, 0150, 0230, 0210, 0230, 0150 
{ 0000, 0000, 0270, 0300, 0200, 0200, 0200 
{ 0000, 0000, 0170, 0200, 0160, 0010, 0360 
{ 0040, 0040, 0160, 0040, 0040, 0040, 0020, 
{ 0000, 0000, 0210, 0210, 0210, 0210, 0170, 
( 0000, 0000, 0210, 0210, 0120, 0120, 0040, 
{ 0000, 0000, 0210, 0210, 0210, 0250, 0120, 
( 0000, 0000, 0210, 0120, 0040, 0120, 0210, 
{ 0000, 0000, 0210, 0210, 0210, 0210, 0170, 
{ 0000, 0000, 0370, 0020, 0040, 0100, 0370, 
{ 0040, 0100, 0100, 0200, 0100, 0100, 0040, 
{ 0040, 0040, 0040, 0000, 0040, 0040, 0040, 
{ 0040, 0020, 0020, 0010, 0020, 0020, 0040, 
{ 0000, 0000, 0010, 0160, 0200, 0000, 0000, 
{ 0370, 0370, 0370, 0370, 0370, 0370, 0370, 



0000, 
0000, 
0000, 
OOOO, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000 , 
0000, 
0000, 
0000, 
0000 , 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000 , 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0010, 
, 0000, 
, 0000, 
, 0020, 
, 0000, 
, 0000, 
, 0000, 
, OOOO, 
, 0000, 
, 0200, 
, 0010, 
, 0000, 
, 0000, 
0000, 
0000, 
0000 , 
0000, 
0000 , 
0010, 
0000, 
0000, 
0000 , 
0000, 
0000 , 
0370, 



0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000 , 
0000 , 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000 , 
0000 , 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0000, 
0010, 
, 0000, 
, 0000, 
, 0020, 
, 0000, 
, 0000, 
, 0000, 
, 0000, 
, 0000, 
, 0200, 
, 0010, 
, 0000, 
, 0000, 
0000 , 
0000, 
0000, 
0000, 
OOOO, 
0010, 
OOOO , 
OOOO , 
OOOO, 
OOOO , 
OOOO, 
0370, 



OOOO } , 
OOOO } , 
OOOO } , 
OOOO ) , 
OOOO ) , 
OOOO ) , 
OOOO } , 
OOOO > , 
OOOO ) , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO ) , 
OOOO ) , 
OOOO ) , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO }, 
OOOO .} , 
.0000 ) , 
OOOO } , 
OOOO },. 
OOOO ) , - 
OOOO ) , 
OOOO ) , 
OOOO ) , 
0160 > , 
, OOOO } , 
, OOOO } , 
, 0140 j , 
, OOOO } , 
, OOOO J , 
, OOOO } , 
, OOOO } , 
, OOOO ) , 
, 0200 } , 
, 0010 } , 
, OOOO }, 
, OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO ) , 
OOOO ) , 
0160 ) , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
OOOO } , 
0370 ), 



demi(dl,d2) 



retum( charitable [dl 3 [d2] ) ; 



if define N_S PLI TTER 4 

struct single_view_info view_inf o[ N_CAMERAS ] ; 
struct prog_settings prog_consts ; 
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load_splitter_locations( ) 
{ 

10 int cam, ret, j; 

char tmp_name [ 16 J ; 
struct boundary_data bnd; 

for (cam = 0 ; cam < N_CAMERAS ; ++cam) { 

for (j = 0 ; j < N SPLITTER ; ++j) < 

sprintf ( tmp_name , "¥ s . %ld" , prog_consts . SPLITTERLOCATIONS [ cam] , j 
ret = get_per_data(tmp_narae, bnd. boundary , & ( bnd . boundaryindex ) , 
15 &(bnd.out 
if (ret i= SUCCESS) exit(l); 

swap_out ( &bnd , view_inf o [ cam ] . xms_handle , ( long ) si zeof ( struct bou 

view_info[cam] . splitter [ j] ) ; 

) 

> 

return ( SUCCESS ) ; 

20 ) 

load_no_zone_images ( image ) char * image; 

i 

int cam, ret, j, x, y, m; 

char trop_name [ 16 ] , header [ FR_HEADER_SIZE ] ; 

for (cam = 0 ; cam < N_CAMERAS ; ++cam) { 

sprintf (t2np_name," %s.% id", "NO_ZONE M , cam); ' 
25 ret = read_f r_pic(tmp_name, image, &x, &y, &m, header); 

if (ret != SUCCESS) { printf ( "\nN0_Z0NE images notfound"); exit(l 
SWAP_OUT_SIZE( image, cam, spots_3 , FR_Y_SIZE*FR__X_SIZE) ; 

return ( SUCCESS ) ; 

> ■ ■■ i > • 

reinit_storage( ) 

30 I 

int r; 

init_xms( ) ; 
init_storage ( 1 ) ; 

r = undump_from_f ile(STORAGE_FILE) ; 
if (r ! = SUCCESS) { 

f printf (stderr, "Can't restore %s", STORAGE FILE); 
35 exit(0); 

return ( SUCCESS ) ; 

init__xms ( ) 
( 

if (is_xms(0)) ; 
„ else { printf ( "\n NO XMS!!"); exit(l); ) 

AO j 

undump_from_f ile (name) char *name; 

( 

int in_file, handles [ N_CAMERAS ] , i, br; 

in_file = open ( name ,( OJRDONLY | OBINARY), o ); 
if (in_file == -1) return (FAILURE) ; 
i = s i zeof (handles ) ; 
br = read ( in_f ile , handles, i); 
close ( in_f ile ) ; 
if ( br i - i ) return ( FAILURE ) ; 
for ( i 0 ; i < N_CAMERAS ; ++i) 

view inf o[ i] .xms handle = handles [ i]; 
return ( SUCCESS \ ; " ~ 

M ) 

50 dump_into_f ile (name) char *name; 

{ 

int outjile, handles ( N__CAMERAS ] , i, bw; 

for ( i = 0 ; i < N_CAMERAS ; ++i ) 

handles[i] - view_inf o[ i ] .xms_handle ; 
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out_file = open ( name, (0_WRONLY J 0_CREAT | 
10 " 0_TRUNC | 0 BINARY ) , (0200 I 0400) ); 

if (out_file == -1) return f FAILURE ) ; ~ 
i = sizeof (handles ) ; 
bw = write (out_f ile , handles, i); 
close(out_f ile ) ; 
if (bw != i) return ( FAILURE ) ; 
return ( SUCCESS ) ; 

15 J 

init_storage ( flag ) 

( 

int cam, handle, kb, j; 
unsigned long offset; 

rdefine SET_OFFSET(a , s ) a = offset; offset s; /* printf ( M \n%ld" offset)- * 
^define LARGE_ BUFFER (unsigned long) ( ( long)L_FR_X_SIZE * (long)L FR Y SIZE) 
.^define MEDIUM_BUFFER (unsigned long ) ( ( long)L_FR_X_SIZE * ( long)L - FR - Y - SIZE) 

* u ^define BOUND ARY_DATA (unsigned long )( sizeof ( struct boundary data!) 

int largest; ~ 
for (cam = 0 ; cam < N_CAMERAS ; ++cam) { 
offset = 0; 

SET_0FFSET{ view_info[ cam] .w_images.gr een, LARGE BUFFER); 

SET_OFFSET ( view_inf o [ cam ] . w_images . red , LARGE~BUFFER ) ; 

SET_OFFSET(view_info[cam] . w_images . ir , LARGE BUFFER) ; 
25 SET_OFFSET(view_info[ cam] .w_images.gr id, LARGE - BUFFER ) ; 

SET_0FFSET ( view_inf o[ cam] . r_i mages . green , . LARGE - BUFFER ) ; 

SET_OFFSET ( view_inf o [ cam ] . r_images . red , LARGE~BUFFER ) ; 

SET_0FFSET(view_inf of cam] . r_images . ir , LARGE~BUFFER ) ; 

SET_OFFSET (view_info[ cam j .r_images. grid, LARGE BUFFER); 

SET_OFFSET( view_inf o [ cam ] . raw_images . green , MEDIUM BUFFER ) ; 

SET_OFFSET(view_inf o[ cam] .raw_i mages. red, MEDIUM - BUFFER ) ; 
30 SET_OFFSET ( view_inf o[ cam] . raw_images . ir , MED1UM~BUFFER) ; 

SET_OFFSET( view_inf o[ cam] . raw_images . grid , MEDIUM - BUFFER ) ; 

SET_0FFSET( view_info[ cam ] ,enhanced_images. green, MEDIUM BUFFER ) 

SET__OFFSET(view_info[cam] . enhanced_images . red , MEDIUM - BUFFER ) 

SET_OFFSET(view_info[cam] . enhanced_images . ir , MEDIUM - BUFFER ) 

SET_OFFSET(view_info[ cam] . enhanced_images . grid, MEDIUM - BUFFER ) 
SETJDFFSET (view_info[ cam] .norma l_images . green, MEDIUM BUFFER); 
35 SET_0FFSET(view_info[cam] . norma l_images . red , MEDIUM~BUFFER) ; 

SET_0FFSET(view_inf o[ cam] . norma l_images. ir , MEDIUM - BUFFER) ; 
SET_OFFSET(view_info[cam] .normal_images.grid, MEDIUM~BUFFER ) * 
SET_0FFSET(view_info[cam] .stem_mask, MEDIUM BUFFER); ~ 
SET_OFFSET( view_inf o[cam] . spots_l , MEDIUM - BUFFER ) ; ■ 
SET_OFFSET ( view_inf o [ cam ] . spots_2 , MEDIUM - BUFFER ) ; 
SET_OFFSET( view_inf o [ cam] . spots_3 , MEDIUM BUFFER) ; 
SET_OFFSET ( view_inf o [ cam J . combi_map , MEDIUM BUFFER ) ; 
W for (j = 0 ; j < NSPLITTER ; j ) ( /* splitter pip holes 

SET_OFFSET( view_inf of cam] . splitter [ j] , BOUNDARY_DATA ) ; 

SET_OFFSET( viewinf o[ cam ] . bnd , BOUNDARY DATA) ; 
SET_0FFSET( view_info[ cam] . bnd_z , BOUNDARY - DATA ) ; 
SET_OFFSET(view_info[cam] .ref_bnd, BOUNDARY DATA); 
if (flag ==0) { /* init XMS as well */ ~ 

45 kb = (offset » 10) + 1; 

handle =• malloc_extended(kb ) ; 

if (handle -= 0 ) < printf ("\n no handles"); exit(0); } 
view_inf o[cam] . xms handle = handle; 

) 
) 

return (SUCCESS ) ; 

) 

swap_out ( buf , xms_handle, size, offset) 

^ PIXEL *buf; int xms_handle; unsigned long offset, 

int ret, handle; 
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ret = xms_mem_move(xms_handle, (void _far *) offset, (unsigned long)size, 
10 o, (void far *)buf); 

if (ret) return ( SUCCESS ) ; 

return ( FAILURE ) ; 

) 

swap_in(buf, xms_handle, size, offset) 

PIXEL *buf; int xms_handle; unsigned long offset, 

{ 

15 int ret, handle; 

ret = xms_mem_move ( 0 , (void _far *)buf, (unsigned long) size, 

xmshandle , (void _far *) offset); 
if (ret) retum( SUCCESS ) ; 

return ( FAILURE ) ; 

) 

read_rul_pic ( f i 1 e_name , mat , s i ze_x , si ze_y , magic_nu ) 
20 PIXEL *mat; char file_name[]; 

int *size_x, *si2e_y, *magic_nu; 

{ 

int in_file, bytes_read, btbr; 
long 1[3]; 
jundef L_SIZE 
#define L_SIZE 4 

in_file = open( f ile_name , (ORDONLY j 0_BINARY) , 0) ; 
25 if (in_file = -1) return(o); 

if ( read(in_file, 1, 3*L_SIZE) != 3*L_STZE) { printf ( »\n error in read 

return ( FAILURE ) ; } 

*magic_nu = ( int ) 1 [ 0 j ; 
*size_x = (int)l[l]; 
*size_y = (int)l[2]; 
btbr = (*size_x) * (*size_y); 
30 bytes_read = read( in_f ile, mat, btbr); 

if (bytes_read 1 = btbr) 

{ return ( FAILURE ) ; } 

close (in_f ile) ; 
return ( SUCCESS ) ; 
J 

re ad_rul_j?ic_ex tended ( f ile_name , mat , size_x , size_y ,magic_nu , header) 
«c PIXEL *raat; char file_name(]; 

char *header; 

int *size_x, *size_y, *magic_nu; 

int in_file, bytes_read, btbr; 
long 1 [ 3 ] ; 
^define LSIZE 4 

in_file = open(f ile_name , ( 0__RDONLY J o_BINARY) ,0) ; 
40 if (in_file == -1) return(O); 

if ( read (in_f ile, 1, 3*L_SIZE) != 3*L_SIZE) ( printf ( "\n error in read #1") 

return ( FAILURE ) ; ) 

*magic_nu = (int)l[0); 
*size_x = (int)l[lj; 
*size_y = (int)l[2]; 
btbr = (*size_x) * (*size_y); 
45 bytes_read = read ( in_f ile, mat, btbr); 

if (bytes_read != btbr) return ( FAILURE) ; 
bytes_read = read( in_f ile , header, FR_HEADER_SIZE ) ; 
if (bytes_read != FR_HEADER_SIZE) return ( N0_HEADER ) ; 
close (in_f ile) ; 
return (SUCCESS); 
) 

^ write_ru_pic_extended(f ile_name , mat , size_x,size_y ,magic_nu , header) 

PIXEL *raat; char file_name[]; 
int size_x, size_y, roagic_nu; 
char * header ; 

{ 
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int out_file; 
long bytes_written , btbr; 
10 long 1 [ 3 ] ; 

out_file = open(file_name, (O WRONLY J 0_CREAT | 

OJTRUNC J 0_BINARY), (0200 | 0400) ) ; 
if (out_file — -1) return<0); 
1[0] = ( long) mag ic_nu; 

= ( long) size_x; 
1[2J = ( long)size_y; 

15 if ( write (out_file, 1, L_SIZE*3) != L_SIZE*3) ( printf ( "\n error in write # 

return (FAILURE) ; ) 

btbr = (size_x) * (size_y); 

bytes written - write ( out_f ile , mat, btbr); 

Tf ( byteswritten ! = btbr ) return ( FAILURE ) ; 
bytes written = write (out_f ile , header, FR_HEADER_SIZE) ; 

Tf ( bytes_written i= FR_HEADER_SIZE) return ( FAILURE ) ; 
20 close(out_f ile) ; 

return ( SUCCESS ) ; 
) 

write_ru_pic( f ile_name, mat , size_x, size_y ,magic_nu ) 

PIXEL *mat; char file_name[J; 
int size_x, size y, magic nu; 

{ 

25 int out_file; 

long bytes_written, btbr; 
long 1[3); 

out_file = open(file_name, (O WRONLY \ 0_CREAT | 

0_TRUNC J 0_BINARY ) , (0200 | 0400) ); 
if (out_file = -1) return(O); 
1[0] = ( long) mag ic_nu; 
2Q 1[1] = (long)size_x; 

1[2] = ( long)size_y; 

if ( write (out_f ile, 1, L_SIZE*3) != L_SIZE*3 ) { printf ( "\n error in write # 

return ( FAILURE ) ; ) 

btbr = (size_x) * (size_y); 

bytes_written = write(out_f ile , mat, btbr); 
if (bytes_written I- btbr) 

\ return ( FAILURE ) ; } 

close (out_f ile) ; 
return ( SUCCESS ) ; 
) 

eliminate_reserved_numbers_l ( image ) 

PIXEL image [ FR_Y_SIZE] [FR X SIZE] ; 

C 

int i,j; 

return ( 1 ) ; 
for (i = 0 ; i < FR_Y_SIZE ; ++i) 
for (j = 0 ; j < FR_X_SIZE ; ++j) 
{ 

if (image[i][j] >= 253) image[i][j] = 253; 
else if ( imagefi] [ j] == 0) image[i][j] = l; 

« » 

display_el iminate(xorg, yorg, image, x_size,y_size, name) char *name, * image; 

eliminate_reserved_numbers_l ( image ) ; 
copy_block( image ,0,0 ,y_size ,x_size ,xorg , yorg) ; 
rectangle ( xorg , yorg ,xorg+x_size , yorg+y size, 255); 
rectangle ( xorg-l ,yorg-l ,xorg+x_size+l , yorg+y_size+l , 255 ) ; 
50 rectangle ( xorg-2 ,yorg-2 ,xorg+x_size+2 , yorg+y size+2 , 255 ) ; 

f illed_rectangle_l(xorg+x_size+2 , yorg+12, xorg+x_size+2+io, yorg+y_size+ 
f illed_rectangle_l(xorg+14, yorg+y_size+2 , xorg+x_size+2+10 , yorg+y size+ 
write_str (xorg+20 , yorg+y_size-6 , name ,1, 254 ) ; ~ 

) 
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display_plain_image(xorg,yorg, image ,x_size,ysize) char *image; 

( 

10 copy_block( image , 0 , 0 , ysize ,x_size,xorg ,y org) ; 

J 

display_plain_magnif ied_3 ( xorg , yorg , image ,x_size ,y_si ze ) 

PIXEL * image ; 

{ 

PIXEL *tmp_buf, *bl, *b2, *b3; 
PIXEL p; 
IS int i,j,s_line, n_size; 

n_size = x_size * 3 ; 

tmp_buf = malloc(n_size * 3); 

if (tmp_buf ==o) { printf ( "\n Not enough memory (display-magni ) " 

return ( 0 ) ; } 
for (i = 0 ; i < y_size ; ++i ) 
{ 

20 bl = trap_buf; 

b2 = bl + n_size; 

b3 = b2 + n_size; 

for (j = 0 ; j < x_size ; 

( 

p - *image++; 

*bl++ = p; *b2++ = p; *b3++ = p; 
25 *bl++ = p; *b2++ - p; *b3++ - p; 

*bl++ = p; *b2++ = p; *b3++ = p; 

) 

copy_block( tmp_buf , 0, 0, 3 * , n_size, xorg, i*3+yorg); 

) 

f ree( tmp_buf ) ; . .. 

x_size *= 3 ; 
30 y_size *= 3; 

) 

display_eliminate_magnif ied _3 ( xorg , yorg , image r x si ze , ysize , name ) 

char *name ; 

PIXEL image [ ] [FR_X_SIZE J ; 

{ 

PIXEL *tmp_buf, *bl, *b2, *b3; 
35 PIXEL p; 

int i,j,s_line, n_size; 

n_size = xsize * 3 ; 

tmp_buf - malloc(nsize * 3); 

if (tmp_buf ==0) { printf ( "\n Not enough memory (display-magni)") 

return ( 0 ) ; } 

eliminate_reserved_numbers_l ( image) ; 
40 for (i = 0 ; i < y_size ; ++i) 

{ 

bl = tmp_buf ; 

b2 = bl + n_size; 

b3 = b2 + n_size; 

for (j = 0 ; j < x_size ; ++j) 

( 

45 p = image [ i J [ j ] ; 

*bl++ = p; *b2++ = p; *b3++ = p; 
*bl++ = p; *b2++ = p; *b3+-f = p; 
*bl++ = p; *b2++ = p; *b3++ = p; 

) 

copy_block(tmp_buf , 0, 0, 3 , n size, xorg, i*3+yorg); 

) 

50 free ( tmp buf ) ; 

x_size *= 3; 
y_size *= 3; 

rectangle(xorg,yorg,xorg+x_size, yorg+y_size, 255) ; 
rectangle (xorg- 1 , yorg- 1 ,xorg+x_size+l , yorg-fy_size+l , 255 ) r 
rectangle ( xorg-2 , yorg-2 , xorg+x_size+2 , yorg+y_size+2 , 255 ) ; 
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write_str( xorg+10 , yorg+y_size-4 ,name,l, 2 54 ) ; 

> 

displaymagnif ied_3 ( xorg , yorg , image , x_size , y_si ze , name ) 

char *name; 

PIXEL image [ ] [ FR_X_SIZE ] ; 

( 

PIXEL *tmp_buf , *bl, *b2, *b3; 
PIXEL p; 

int i,j,s_line, n_size; 

n_size = x_size * 3 ; 
tmp_buf = malloc(n_size * 3); 

if (trop_buf ==0) { printf ( "\n Not enough memory (display-magni ) ) 

return ( 0 ) ; ) 
for (i = o ; i < y_size ; -M-i) 
< 

bl = tmp_buf ; 
20 b2 « bl + n_size; 

b3 = b2 + n_size; 

for (j = 0 ; j < x_size ; ++j) 

( 

p = image[i][ j] ; 

*bl++ = p; *b2++ = p; *b3-M- = p; 
*bl++ = p; *b2++ = p; *b3++ = p; 
25 *bl++ = p; *b2++ « p; *b3++ = p; 

> - 
copy_block( tmp_buf , 0, 0, 3 , n_size, xorg, i*3+yorg) ; 

) 

free( tmp_buf ) ; • 

x_size *= 3; . . . ■ 

y_size *= 3; 

30 rectangle (xorg, yorg, xorg +x_size, yorg+y_size , 255 ) ; 

rectangle ( xorg- 1 , yorg- 1 ,xorg+x_size+l , yorg+y_size-f-l , 255) ; 
rectangle (xorg-2 , yorg-2 , xorg+x_size+2 , yorg+y_size+2 , 255 ) ; 
wri te_str ( xorg+10 , yorg+y_si ze-4 , name ,1,254); 

) 

sleep_ms ( mseconds ) 
( 

35 time_t tml , tm2 ; 
double dt, dtr; 
clock_t tl, t2; 

tl = clock < ) ; 

do ( 

t2 « clock ( ) - tl; 

if (kbhit()) ( getch(); retum(O); ) 
4Q ) while (t2 < ( clock_t ) (mseconds ) ) ; 

return(l); 

> 

load_color_map(char *name) 
< 

FILE *map_file; 
int r,g,b, i, ret; 
short lut[256] [4] ; 
char * t_env , namex [80]; 

map_file = f open ( name, M r M ) ; 

if ( map_f ile — NULL ) 

( 

t_env = getenv( "C_LUTS" ) ; 
strcpy ( namex , t_env ) ; 
s treat ( namex r name ) ; 
50 t_env = strchr ( name , • . 1 ) ; 

if (t_env NULL) strcat ( namex , " . lut" ) ; 
map_file = f open (namex, "r" ) ; 

) 

if (map_file == NULL) ( printf ( "\n File %s Not exists" , name) ; 
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retum(O); ) 
for (i = 0 ; i < 256 ; ++i) 
10 { 

ret = fscanf (map_f ile , "%d %d %d%* [ * \n ] " , &r , &g , &b) ; 

if (ret — EOF) break; 

lut(i][ RED] = r; lut[ij[ GREEN] = g; 

lut[i][ BLUE] = b; 

lut[i][ FILLER] = O; 

} 

15 f close (ma p_f ile ) ; 

return ( 1 ) ; 

) 

read_map_f i 1 e ( name , lut ) 

char *name; 

short lut [256] [4]; 

t 

20 char n [ 3 2 ] , *t_env ; 
int ret, i; 
FILE *map_file; 
int r,g,b; 

map_file - f open ( name , "r" ) ; 

if (map file = NULL) 

{ 

25 t_env = getenv( "C^LUTS" ) ; 

strcpy ( n , t_env ) ; 
strcat ( n , name ) ; 
t_env = strchr(n, ' . • ) ; 
if { t_env = NULL) strcat (n , " . lut" ) ; 
map_file = f open(n, "r" ) ; 

) 

30 if (map_file = NULL) return ( FAILURE ) ; 

else 
{ 

for (i = 0 ; i < 256 ; ++i ) 
{ 

ret « f scanf (map_f ile, "%d %d %d%* [ ~\n] " , &r , &g ,&b) ; 
if (ret = EOF) break; 

35 lut[i]C RED] = r; lut[i] [_GREEN] = g; lut[i][ BLUE] 

lut[i][ FILLER] = 0; 

> 

> 

f close (map_f ile) ; 
return ( SUCCESS ) ; 

} 

4Q output_header ( h ) char *h; 

{ 

# define LINE_LEN 72 
int len = strlen(h); 
int t, 1; 
char c; 

for (i = 0 ; i < len ; i += LINE_LEN) 
45 i 

1 = i + LINE_LEN; 

if (1 >= FR_HEADER_SIZE ) 1 = FR_HEADER_S I Z E - 1 ; 
c = h[l]; h[l] = 0; 
printf ("%s°,&h[i]); 
h[l] = c; 

J 

} 

pic_invert_x(p,x,y) char *p; 

char *cl, *c2, c; 
int i , j ; 

for (j =s 0 ; j < (x » 1) ; ++j) 

55 



50 



157 



EP 0 566 397 A2 



10 



15 



cl = p+j; 
c2 = p+(x- j-1 ) ; 
for (i = 0 ; i < y ; ++i ) 
{ 

c ~ *cl; *cl = *c2; *c2 - c ; cl += x; c2 += x; 

) 

} 

) 

pic_invert_y(p,x,y) char *p; 

{ 

char *li, *12, cr 
int i , j ; 

for (i = 0 ; i < (y >> 1) ; ++i ) 
( 

11 = p+i*x; 

12 = p+(y-i-l)*x; 

20 for (j = 0 ; j < x ; ++j) 

{ 

c = *11 = *12; *12 = c; ++11; ++12; 

) 

} 

) 

write_byte_stream(f ile_name , image, x, y) 
25 char *f ile_name , * image; int x,y; 

< 

int out_file; ■ . ■ 

long bytes_written, btbr; 

out_file = open(f ile_name, (0_WRONLY | 0_CREAT | * * • 

if (out_file == -1) return(O); 
30 btbr = x * y; 

bytes written - write (out_f ile , image, btbr); 

If (bytes_written != btbr) return ( FAILURE) ; 
close ( out_f ile ) ; 
return ( SUCCESS ) ; 

) 

read_byte_stream(f ile_name, image, x, y) 
35 char *file_name, *image; int x,y; 

< 

int in_file; 

long bytes_read, btbr; 

in_file - open( f ile_name , (0_RDONLY | 0_BINARY) , 0) ; 
if (in_file — -1) return (0); 
btbr = x * y; 
40 bytes read = read(in_f ile, image, btbr); 

If (bytes^read != btbr) return ( FAILURE ) ; 
close ( in_f Tie ) ; 
return ( SUCCESS ) ; 

} 

z_transf orin_f (dst , src, mean_p, mad__p, min_p, max_ p) 

PIXEL dst[FR_Y_SIZE][FR_X_SIZE] ; 
45 PIXEL src[FR_Y_SIZE3[FR^X_SIZE] ; 

int *mean_p, *mad_p, *mXn_p, *max_p; 

int i,j, mean, k, mad, ignore_flag; 
ignore_flag = 0; 

mean = f_mean(src,min_p, roax_p,8, ignore_f lag) ; 
mad = c_mad(src, mean, 8, ignore_f lag ) ; 
50 /* make mad fixed */ 

mad = 18; 

do_s_transform_iraage(dst, src, mean, mad); 
if (debug_flag) 

printf("\n min: %d max; %d mean: %d mad: %d M ,*min_p, *max_p, 
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w ~ 0 

return ( SUCCESS ) ; 

10 > 

z_transf orm(dst, src, mean_p, mad_p, min_p, max_p ) 

PIXEL dst [ FR_Y_SIZE ] ( FR_X_SIZE] ; 
PIXEL src[FR_Y_SIZE] [FR_ i _X_SIZE] ; 
int *mean_p, *mad_p, *mTn_p, *max_p; 

{ 

int ret, x, y, mad, mean, ignore_flag; 
ignore_flag = 0; 

mean = f __mean(src , min_p , max_p,8, ignore_f lag ) ; 
mad = c_mad(src, mean, 8, ignore_f lag) ; 
do_s_transform_image(dst , src, mean, mad); 
if (debug_flag) 

printf( M \n min: %d max: %d mean: %d mad: %d",*min_p, *max_j>, mea 
*mean_p - mean; _ — 

*mad_p = mad; 
20 return ( SUCCESS ) ; 

) 

f_mean_env(buf /pmin^max, shoulders , ignore_flag, iO, jo, env ) 

PIXEL buf [ ) [ FR_X_S I ZE ) ; 
int *pmin , *pmax ; 

< 

int i,j, imx, jmx; 
25 unsigned int n; 
double mean, f; 
int min = 255, max = 0; 

/* find mean */ , 
mean =0.0; ■ ■ * . ■ • 

n = 0; 

for (i = io-env ; i < io+env ; ++i) 
30 ( 

f = 0.0; 

for (j = jO-env ; j < jO+env ; 
{ 

if (buf[i][j] > 253) continue; 

if ( ignore_f lag && buf [ i] [ j ] • < 64 ) continue ; 
f (double)buf [i][ j] ; 
2$ if {buffi} [j] < min) min = buf[i][j]; 

if (buf[i][jj > max) { max = buf[ij[j]; imx = i; jmx = j; } 

++n ; 

> 

mean += f ; 
> 

if (n < 2) return(255); 
mean /= (double )n; 
*pmin = min; 
*pmax = max; 

return ( ( int ) ( mean+0 . 5 ) ) ; 

) 

f _mean( buf ,pmin,pmax, shoulders, ignore_f lag) PIXEL buf [][ FR_X SIZE] ; 

int *pmin, *pmax; 

{ 

45 int i , j , imx , jmx ; 
unsigned int n; 
double mean, f; 
int min = 255, max = 0; 

mean = 0.0; 

n = 0 ; 

for (i = shoulders ; i < FR_Y_SIZE - shoulders ; ++i) 
50 i 

t = 0.0; 

for (j = shoulders ; j < FR_X_SIZE - shoulders; ++j) 
if (buf[i][jj > 253) continue; 
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if (ignore_flag buf[i][j] < 64) continue; 
10 if (buf [i+8J[j] > 253 || buf[i-8)[j] > 253 || buffi][j-8] > 253 }| 

buf[i)[j+8] > 253) continue; 
f += (double )buf [i][ j); 
if (buf[i][ j] < min) min = buf[i][jj; 

if ( buf [ i ] [ j j > max ) { max = buf [ i 3 [ j ] ; imx = i ; jmx = j ; 
++n; 

} 

15 mean += f ; 

> 

if (n < 2) return (255); 

mean /- (double )n; 
*pmin = min; 
*pmax = max; 

return ( ( int ) ( mean+O . 5 ) ) ; 

20 do_f loat_image (buf , mean, shoulders) 

PIXEL buf [ ] [ FR_X_SIZE ] ; 
int mean; 

( 

int i,j, n; 

for (i = shoulders ; i < FR_Y_SIZE - shoulders; ++i) 
for (j = shoulders ; j < FR_X_SIZE - shoulders ; ++j) 
25 { 

if (buf[i][j] > 253) continue; 

n = buf[i][j] - mean +128; 

if (n < 0) n = 0; ... 

if (n > 250) n - 250; 

buffi]{ j] = n; . 

) 

30 ) 

do_f loat_single( value , mean) 

int mean, value; 

{ 

int n; 

if (value > 253 [| mean > 253) n = 255; 
else { 

3 5 n = value - mean + 128; 

if (n < O) n = 0; 
if (n > 250) n - 250; 
) 

return ( n ) ; 

) 

do_s_transf orm_image(dst , src, mean, mad) 
PIXEL dst [ ] [ FR_X_SIZE ] ; 
40 PIXEL src[ ] [FR_X_SIZE] ; 

( 

int i,j, k; 

double f, fmad = (double) mad; 

for (i = 0 ; i < FR_Y SIZE ; ++i ) 

for (j = 0 ; 3 < FR_X_SIZE ; ++j) 
( 

45 if (src{i][j] > 253) { dst[i][j] = src[i][j] ; continue; ) 

k = src[i][j] - mean; 

f = ( double )k / f mad ; 

/* scale to 100 is 3*/ 

f m f * ioo. / 3. ; 

k = 128 + (int) (f+0.5) ; 

if (k < 0) k = 0; 
50 if (k > 255) k = 255; 

dst[i][j] = ( PIXEL) k; 

) 

} 

c_raad ( buf , mean, shoulders, ignore_flag) 
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PI XEL buf [ ] [ FR_X_S I ZE ] ; 
fO int mean; 

{ 

int i , j , n ; 
double mad,f ; 

mad = 0.0; 

n = 0; 

for (i - shoulders ; i < FR_Y_SIZE - shoulders; ++i) 

15 I 

f = 0.0; 

for (j = shoulders ; j < FR_X_SIZE - shoulders ; 
{ 

if (buf > 253) continue; 

if (ignore_flag && buf[i][jj < 64 
f += ABS((buf [i][ j] - mean)); 
++n; 

> 

mad += f; 

) 

if (n < 2) return(255); 
mad /= ( double )n; 
return (( int ) (mad +0.5)); 

25 f_mean_mask(buf ,pmin,pmax, shoulders, mask) 

PIXEL buf [ ] [FR_X_SIZE] ; 
PIXEL mask [ ] [ FR_X_SIZE ] ; 
int *pmin, *pmax; 

{ 

int i, j, imx, jmx; 
unsigned int n; 
30 double mean, f ; 

int min = 255, max = 0; 

mean = 0.0; 

n = 0; 

for (i = shoulders ; i < FR_Y_SIZE - shoulders ; -r+i ) 
{ 

f = 0.0; 

oc for (j = shoulders ; j < FR X SIZE - shoulders; -M-j) 

( 

if (buf[i][j] > 253) continue; 
if (mask[i}[j] > 10) continue; 
if (buf [i+8] [j] > 253 j| buf [ i-8 ] [ j ] > 253 || buf [ i ] [ j-8 ] > 2 

buf [i][j+8] > 253) continue; 
f += (double) buf [i] [ j] ; 
if (buf [i] [ j ] < min) min = buf[i][j]; 

if ( buf [ i ] [ j ] > max ) { max = buf [ i ] [ j } ; imx = i ; jmx = j ; } 
++n; 

} 

mean += f ; 
) 

mean /= (double)n; 
*pmin = rain; 
45 *pmax — max; 

return ( ( int ) ( mean+0 . 5 ) ) ; 

) 

c_mad_mask ( buf , mean , shoulders, mask) 

PIXEL buf [ ] [ FR_X_S I Z E ] ; 
PIXEL mask[ ] [ FR_X_SIZE] ; 
int mean ; 

50 { 

int i , j , n ; 
double mad,f; 

mad = 0.0; 

n = 0; 
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for (i = shoulders ; i < FR_.Y_SIZE - shoulders; ++i) 
f = 0.0; 

for <j = shoulders ; j < FR_X_SIZE - shoulders ; ++j) 
{ 

if (mask[i][j] > 10) continue; 
if (buf[i](j] > 253) continue; 

if (buf[i+8][j] > 253 J| bufri-8][j] > 253 || buf[i][j 
15 buf[i][j+8] > 253) continue; 

f ABS( (buf [i][ j] - mean)); 
•f+n; 

} 

mad += f; 

) 

mad /= ( double )n; 
2Q return (( int) (mad +0.5)); 

static struct { unsigned int min_area; 

int min_angle; 
int cx, cy; 
int xl, x2, yl, y2; . 
) caliber_data; 

enclosing_rectangle_chain(chain, start_i, start_ j , xybuf , xip., yip, x2p, y2p, ang 
25 char chain[ ] ; 

struct point xybuf [ ] ; 

int *xlp, *ylp, *x2p, *y2p, *anglep? *' 

struct point xybuf _r[MAX_LENGTH] ; - 
int min_i, min_ j , maxi , max dl f d2, len; . * - •' ' 

caliber_data. min_area =160*180; • 
30 len = chain_to_raster( start _i , startj, chain, 

x 

get_centroid ( len , &caliber_data . cy , &caliber_data . cx , xybuf ) ; 
do_rot_ca liber (len, &dl , &d2 , xybuf, xybuf_r, caliber_data -cx, caliber_da 
*xip — caliberdata.xl; /* + caliber_data .cx; */ 

*ylp = caliber_data . yl; /* + caliber_data . cy ; */ 

*x2p = caliber_data .x2; /* + caliber_data. cx; */ 

2_ *y2p = caliber_data.y2; /* + caliber_data . cy; */ 

*anglep = caliber_data.min_angle; 

) 

do_rot_caliber( len, dip, d2p, xybuf, xybuf __r, cx, cy) 

int *dlp, *d2p; 
struct point xybuf [], xybuf _r[ J ; 

( 

int angle, 12, 11; 
40 struct rect occ__rect: 

*dlp = INT_MIN; *d2p = INT_MAX; 

/* last iteration should be angle == 0 */ 
for (angle = 90 ; angle > 0 ; angle -= 5) 
{ 

/* first, rotate it */ 
rotate_xy(angle ,cx, cy, len, xybuf, xybuf_r); 
45 /* now check for occluding rectangle */ 

occluding_xy ( &occ_rect , len, fill, &12, xybuf_r); 
setcaliber_data(occ_rect , angle, 11, 12, dip, d2p); 

) 

) 

set_caliber_data(occ_rect , angle, 11, 12, dl, d2 ) 
int *dl, *d2; 
struct rect occ rect; 

SO ( 

unsigned int area; 

area = (occ_rect.x2 - occ^rect.xl) * 

(occ_rect.y2 - occ_rect . yl ) ; 
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10 



15 



20 



25 



30 



35 



40 



if (area < caliber_data . min_area ) ( 

caliber_data.min_area = area; 
caliber_data.min_angle - angle; 



) 

occluding_xy(occ_rect, len , lip, I2p, xybuf _r) 
struct point xybuf__r[]? 
struct rect *occ_rect; 
int *llp f *12p; 



caliber_data . xl 
caliber_data.x2 
caliber_data . yl 
caliber_data - y2 



= occ_rect 
= occ_rect 
— occ_rect 
= occ rect 



{ 

int 
int 



x f y, 
min x 



max_x_i , mm x 
= INT_MAX, mTn" 



for (i 
{ 



x , max_y_a , min_y_i 
y = INT_MAX , max_x 
i < len ; ++i) 



INT_MIN, max_y = INT_MIN; 



x = xybuf _r [ i ] . x ; 
y = xybuf _r [ i j . y ; 



) 

occ_rect->xl 
occ_rect->x2 
occ_rect->yl 
occ_rect->y2 
*llp = max_x 
*12p = max_y 



if (x 
else if 
if (y < 
else if 

rain_x ; 
max_x ; 
rain_y ; 
max_y ; 
min_x ; 
min__y ; 



imn_x ) 
(x > max 
roin_y ) 
(y > max_y) 



:_x) { 
{ 



Ti»in_x = 
max_x = 
min_y = 
max_y = 



min_x_i « i ; 
max_x_i - i; 
min_y_i = i; 
max_y_i = i; 



) 

rotate_xy(angle__deg, cx, cy, len, 
( 

double angle = 3 . 14 159* (double ) angle_deg/180 . ; 
double sin_a = sin(angle), cos_a = cos(angle); 
double f_x, f_y; 
int x,y, i; 
static color = 10; 

for 



xybuf , xybuf _r ) 

struct point xybuf [ ] , 



xybuf __r[ ] ; 



(i = 0 ; i < len 



y = xybuf ( i ] . x ; 
x = xybuf [ i ] . y ; 

f_x = -(double) (y - cy)*sin_a + (double) (x- cx)*cos_a; 
f_y = (double) (y - cy)*cos_a + ( double )(x- cx)*sin_a; 



y - (int) (f_y 
x - (int) (f_x 
xybuf _r[ i ] .x = 
xybuf_rf i ] . y = 



cy 
cx 



0.5); 
0.5) ; 



45 



50 
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int *x, *y; 



color 5; 

) 

rota te_po int (x, y, angledeg, cx, cy) 
{ 

double angle = 3 . 14159* (double )angle_deg/180 . ; 
double sin_a - sin(angle), cos_a = cos(angle); 
double f_x, f_y; 

f_x = -(double) (*y - cy)*sin_a + (double) (*x- cx)*cos_a; 
f_y = ( double )(*y - cy)*cos_a + (double) (*x~ cx)*sin_a; 
*y = ( int ) ( f _y 4- cy + 0.5); 
*x = (int) (fx + cx + 0.5); 



} 

get_centroid( len, cxp, cyp, xybuf) 



int *cxp, *cyp; 
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{ 

int i ; 

long sum_x, sum_y; 

sum_x = 
for (i 
{ 



struct point xybuf [ j ; 



sum_y = 0; 
= 0 ; i < ien 



sum_x 
sum_y 



+= xybuf [i] . x; 
+- xybuf [ i ] . y ; 



7 
4 

2 
1 

14 



*cxp = (int) C (double )sura_x / (double ) len) ; 
*cyp = (int) ( (double )sum_y / ( double) len ) ; 

J 

^define DISPLAY_RESOLUTION 1 

#undef RED 

#undef GREEN 

Sundef BLUE 
#define^ 
#def ine 
#def ine 
#def ine 
^define 
#define 

^define MAGENTA 5 
#define GRAY 8 
tfdefine _ 

#define LIGHT RED 12 
#def ine 
jjdef ine 
#def ine 
#def ine 
#def ine 
#def ine 
#define 
static FILE 
static float 



WHITE 
RED 
GREEN 
"BLUE 
YELLOW 
CYAN 
MAGENTA 
GRAY 

BROWN 6 
LIGHT RED 
L I GHT_GREEN 
L I GHT_BLUE 
LIGHT_YELLOW 
LIGHT_CYAN 
LIGHT_MAGENTA 
INTENSIFIED_WHITE 15 
BLACK 0 
*out_f ile; 
FACTOR=0 . 6 ; 



10 



14 



13 



11 



double calc_blemish_area( ) ; 

extern struct prog_settings prog_constsr /* process setup file */ 
extern int debug_flag; 

extern int n_steias, stem_index, calyx_index; 
extern struct c_dat candidates [ MAX_CANDIDATES ] ; 
extern int global_color_grade , apple_size; 
static unsigned long p_count = 0; 
int combine_masks( mask , blemish) 

PIXEL mask[FR_Y_SIZE] [FR_X_SIZE] ; 

PIXEL *blemish; 



int i , j , r ,def ult_color ; 
extern int apple_brand; 
#ifndef DISTRIB_COLOR 

switch ( applebrand ) 
( 



case SMITH type : 



defult colors GREEN 



case ANA_TYPE: 
case HERMON_TYPE: 
case ORLEANS TYPE: 



defult color= RED 



fcendif 



) 

for (i=0, r=0 ; i < FR_Y_SIZE ; i++ , r+=FR_Y_SIZE ) 
for (j=0 ; j < FR_Y_SIZE ; j++) 
( 

if (* (blemish + r + j ) > 50 && mask[i][j] > 0) 
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10 



15 



20 



25 



Sifdef DISTRIB COLOR 



jfelse 
#endif 



/* set base color with random */ 
p_count = rand ( ) ; 

if (pcount < (RANDMAX » (15-9) 

switch (mask[ i ] [ j ] ) 
{ 

case SIMPLE_RED_C 
*( blemish 
break ; 

case DARK_RED_COL 
*( blemish 
break ; 

case O RANG E_CO LOR 
* (blemish 
break ; 

case GR£EN_COLOR 
* (blemish 
break; 

case YELLOW_COLOR 
* (blemish 
break; 

> 

*( blemish + r + j) s =defiil- 



} 

do 3dfi 



30 



35 
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50 



> . 

le(name, bndO , bndl , bnd2, iraageO , imagel, image2 , color_mask, t_volume ) 

char *name; 

PIXEL imageO [FR_Y_SIZE] 
PIXEL imagel [FR_Y_S I ZE] 
PIXEL image2[FR_Y_siZE] 
PIXEL color_mask[FR_Y_S 
struct boundary_data *b 
struct boundary_data *b 
struct boundary _data *b 

double *t_volume; 

int i; 

PIXEL * point [ N_CAMERAS ] ; 

/* get data from XMS */ 
SWAP_IN_SIZE(bndO , CAM_1 , bnd, sizeof (struct boundary_data )) ? 
SWAP_IN_SIZE ( bndl , CAM_2 , bnd , sizeof ( struct boundary_data ) ) ; 
SWAP_IN_SIZE(bnd2, CAM_3 , bnd, sizeof ( struct boundary_data )) ; 

SWAP_IN_SIZE ( imageO , CAM_1 , combi_map , FR_Y_SIZE*FR_X_SIZE ) ; 
SWAP_IN_SIZE ( image 1 , CAM_2 , combi_map f FR_Y_SIZE*FR_X_SIZE ) ; 
SWAP_IN_SIZE ( image 2 , CAM_3 , . combi_map , FR_Y_SIZE*FR_X_SIZE ) ; 



smooth_bnd ( bndO ) 
smooth_bnd ( bndl ) ; 
smooth_bnd ( bnd 2 ) ; 

point [ 0 ] =imageO [ 0 ] ; 

point [ 1 ] =image 1 [ 0 ] ; 

point [ 2 ] =image2 [ O } ; 

for (i=0 ; i < N_C AMERAS ; i++) 



/* this is to ensure smoo 



Combine the color mask with 



{ 

SWAP_ i _IN_SIZE(color_mask, i, spots_l , FR_Y_SIZE*FR_X_SIZE ) ; 

combTne_masks (color_mask, point [ i ] ) ; 

} 

make_draw_f ile(name, bndO, bndl, bnd2, imageO, 



gifdef MAKE_XMS_BND_Z 

S WAP_OUT_S I Z E ( bnd 0 , 



CAM_1 ,bnd_z , sizeof ( struct boundary_data ) ) ; 
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SWAP_OUT_SIZE<bndl , CAM_2 , bnd_z , si zeof ( struct boundarydata ) ) ; 
SWAP_0UT_SIZE(bnd2, CAM__3 , bnd_z , si zeof ( struct boundary_data ) ) ; 

# end if 

10 printf( M \n Volume : %4d cc\n" , ( int ) ( *t_volume /1000.)); 

return (SUCCESS ); 

> 



smooth_bnd ( bnd ) 
{ 

for (i - 1? i < bnd -> boundary_index-l ; ++i ) 



struct boundary_data *bnd; 



int i,j, y 1, xl 1, x2 1, y_2 , xl_2 , x2_2 , y_3 , xl_3 , x2J 

15 — ~ - ' - ' -»-—_» - • « £ » - 



if (i > 1) 

20 



y_l = bnd -> boundary [ i-1 ] .y ; 
xl_l = bnd -> boundary [ i-1 ]. xl ; 
x2_l = bnd -> boundary [ i-1 ] . x2; 



bnd->boundary[ i-1 ] . y = y_2; 
bnd->boundary[ i-1 j .xl = xl_2 ; 
bnd->boundary[ i-1] .x2 = x2_2 ; 

> 

y_2 - bnd -> boundary [ i ]. y ; 
xl_2 = bnd -> boundary [ i] .xl; 
x2__2 = bnd -> boundary [ i ]. x2 ; 
25 y_3 = bnd -> boundary [ i+1 ]. y ; 

xl_3 = bnd -> boundary [ i+1] .xl; 
x2_3 = bnd -> boundary[i+l] .x2 ; 
y__2 = (y_2 + y_2 + y_l + y_3 ) » 2; 
xl_2 = (xl_2 + xl_2 + xl_l + xl_3) » 2; 
- . x2_2 = (X22 + X22 + x2_l + x2 3) » 2; 

> 

30 ) 

make_draw_f ile(name, bndO, bndl , bnd2, maskO, maski, roask2, volp) 

char *name; 

PIXEL maskO[FR_Y_SIZE] [ 
PIXEL maskl[FR_Y_SIZE][ 
PIXEL raask2 [ FR_Y_SIZE ] [ 
struct boundary_data *b 

35 struct boundary_data *b 

struct boundary_data *b 
double *volp; 

{ ' 

double t_volume; 
double draw_all( ) ; 
float so[3] ,no[3] ; 
40 void imagin_stem_calix_coord( ) ; 
char namel[64}; 

strcpy(namel , "E:\\">; 
s treat ( name 1 , name ) ; 
out_file = fopen(namel, V); 
if (out_file = NULL) ( 

printf ( "\n Can't open %s" , name); 
return ( FAILURE ) ; 
) 

printf ( "\n %s opened", name); 

t_volume = draw_a 11 ( bndO , bndl , bnd2 , maskO , maskl , mask2 , prog_consts . earner 
f printf (out_file, " -40.0 -40.0 -40.0 1 4 \n" ) ; ~~ 
fprintf (out_f ile, » 40.0 40.0 40.0 1 4 \n" ) ; 
qq imagin_stem_calix_coord ( bndO , bndl , bnd2 ,no,so, prog_consts . camera_distance ) ; 

fprintf (out_file, " %7 . 2f %7.2f %7 . 2f %2d %ld\n" , so[ 0 ] , so [ 1 ] , so [ 2 ] , 
fprintf (out_f ile, » %7 . 2f %7.2f %7 . 2f %2d %ld\n" , no [ 0 J , no [ 1 ] , no [ 2 j , 
f close (out_f ile) ; 
*volp = t_volume; 
return ( SUCCESS ) ; 

> 
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double draw_all(bndO,bndl ,bnd2, maskO, maskl, mask2, camera_distance ) 

int *camera^distance; 
10 struct boundary_data *bndO , *bndl , *bnd2 ; 

PIXEL maskO[FR_X_SIZE][FR_Y_SIZE] , maskl[FR Y SIZE)[FR 
PIXEL mask2[FR_X SIZE][FR Y SIZE] ; ~ 

< 

int Xl[N_CAMERASJ , x2[N_CAMERAS] , y [ N_CAMERAS J , x, i, xzl£N CAMERAS ] , x Z 2 [ N CA 

size [ 3 ] , dif f [ 3 ] , xll [ N_CAMERAS ] , xl 2 [ N_CAMERAS ] , min_y , begTn_va 1=1 , j ; ~ 
double volume, area; 
15 float y_height , min_height, z_3d[ 3 ] ; 

double conipute_line_all( ) ; 

fprintf (out_f ile, "Set Color %2d\n",10+0 /* cam^number */): 

/* Set the boundary sizes of all the cameras to be the same size 
if ( (size[ 0]=bndO->boundary_index) > ( size[ 1 ]=bndl->boundary_inde 

min_y=l; 
else min_y— 0 r 

20 if C (size[ 2 ]=bnd2->boundary_index) < size[min y]) 

min_y=2; 

dif f [ (min_y+2)%3]=size[ (min_y+2 ) %3 ]-size[min_y ] ; 

if ( (diff [ (min_y+l)%3]=size[ (min_y+l) %3 ]-size[min_y] ) > SIZE_BND 
dif f [ (min_y+2)%3] > SIZE_BND__DIFF_LIMIT ) { ~ 
if (debug_flag) printf("\n WARNING : Boundary structurs 

25 dif f [min_y j=0; 

for (i=0 ; i < N_CAMERAS ; i++) ( 
if (size[i]=0) continue; 
diff [i]/=2; 

) 

y_height=( *cameradistance+( * ( camera_distance+l ) ) + 

'{ *(camera_distance+2) ) )*CCD_SIZE_Y/( (float) CCD RESOLU 
30 min_height=y_height*size[min_y]/2 . ; 

fprintf (out_f ile, "PointList X Y Z Color Layer\n"); 
Ufdef MAKE_XMS_BND_Z 

bndO->out_rect .yl^bndO -> boundary [ begin_val+d if f [0] ] .y ; 
bndl->out_rect . yl=bndl -> boundary [ begin_val+dif f [ 1] ] .y; 
bnd2->out_rect.yl=bnd2 -> boundary [begin_val+dif f [ 2] ] .y ; 

#endif 

35 volume = 0 . ; 

/* Line loop exeqution & bnd_z structur setting */ 
for (i - begin_val; i < size (min_y]-begin_val ; ++i) 

y[0] = bndO -> boundary [ i+diff[ 0 ]] .y; 

xl [0] = bndO -> boundary [i+d if f [0 ] ] .xl; 

x2[0] = bndO -> boundary [i+d if f [0] ] .x2; 
40 y[l] = bndl -> boundary [ i+diff [1 ] j . y; 

xl[l] = bndl -> boundary [i+dif f[l] J .xl; 

x2[l] = bndl -> boundary [ i+diff [1] ) ,x2; 

y[2] = bnd2 -> boundary [ i+diff [ 2 ]] .y; 

xl[2] = bnd2 -> boundary [i+diff [2] ] .xl; 

x2[2] = bnd2 -> boundary [ i+diff [ 2 ]] .x2 ; 
area=compute_line_all(xl, x2 , camera_di stance ,xzl , xz2 ,xll ,xl2) 
45 make_line_dr awing ( xzl, xz2,xll,xl2, camera_dis tance , mask 

maskl[y[l] ] ,mask2[y[2] ] ,min height) ; 
iifdef MAKE_XMS_BND_Z ~ 
bndO -> boundary [ i-begin_val ]. y = y[0]; 

bndO -> boundary[i-begin_val] .xl = xzl[0]; 

bndO -> boundary [ i-begin_val ] .x2 = xz2[0]; 

bndl -> boundary[i-begin_val] .y = y[l}; 
50 bndl -> bound ary[i -beg in_val] .xl = xzl[l]; 

bndl -> boundary[i-begin_val] .x2 = xz2[l]; 

bnd2 -> boundary [i -beg in_val] .y = y[2]; 

bnd2 -> boundary(i-begin_val] .xl = xzl[2]; 

bnd2 -> boundary [i -beg in val].x2 = xz2[21 ; 

Sendif 
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20 



min_height-=y_height ; 
fO volume += area * y_height; 

) /* of single line loop */ 
=if def MAKE_XMS_BND_Z 

bnd0~>out_rect.y2=bnd0 -> boundary [ ( — i )+dif f f 0 ] ] . y ; 
bndl->out_rect .y2=bndl -> boundary [ ( — i)+diff [ 1] ] .y; 
bnd2->out_rect .y2=bnd2 -> boundary [ ( — i)+diff[2]].y; 

bnd0->boundary_index=bndl->boundary_index=bnd2->boundary_index=size[min 

15 =endif 

return ( volume ) ; 

) 

double compute_line_all(xi , x2, cam_dist,XZl,XZ2 ,XL1 ,XL2) 

int *xl ,*x2,*cam_dist,XZl[N_CAMERAS] , XZ2 [ N_CAMERAS ] , XL1 [ N_CAMERAS ] , XL2 [ N 

{ 

int i, center; 

int zXl [ N_CAMERAS ] , ZX 2 [ N_CAMERAS ] ; 

double Curve_Area; 
center=FR_X_SIZE/2 ; 
for ( i=0 ; i < NCAMERAS ; i++) { 
zXl[ i ] =center- ( * ( xl+i ) ) ; 
zX2[i]=(*(x2+i) ) -center; 

> 

calc_line(zXl[0] , zX2[0] , zXl[l] ,zX2[l] ,zXl[2] , zX2[2] ,cam__dist) ? 
25 do_bezier_interp( FACTOR ) ; 

calc_area ( &Curve_Area ) ; 
calc_curves^j?rojections(cam_dist,XIjl,XI,2) ; * .- 

calc_sight_liraits(cam_dist,XZl,XZ2) ; 

for (i=0 ; i < N_CAMERAS ; i++) { 
. * ^ XZl>[i ]=center-XZlti] > 
X Z 2 [ i ] =XZ 2 [ i ] +center ; 

30 ) 

return ( Curve_Area ) ; 

> 

=undef XI 
=undef X2 

double compute_line_area(xl, x2, cam_dist ,XZ1 ,XZ2 ) 

int *xl,*x2,*cam_dist,XZl[N_CAMERAS] r XZ2[N_CAMERAS ] ; 

35 ( 

int i, center; 

int XI [ N_C AMERAS ] , X2 [ N_CAMERAS ] ; 
double Curve_Area ; 
center=FR_X SIZE/2; 
for (i=0 ; I < N_CAMERAS ; i++) { 
XI [ i ] =center- ( * ( xl+i ) ) ; 
M X2[i]=(*(x2+i) )-center; 

} 

calcJLine { XI [ 0 ] , X2 [ 0 ] , XI [ 1 ] , X2 [ 1 ] , XI [ 2 ] , X2 [ 2 ] , cara_dist ) ? 
do_be zier__interp ( FACTOR ) ; 
calc_area( SCurveArea ) ; 
calc_sight_limits ( cam_dist , XZ1 , XZ2 ) ; 
for (i=0 ; i < N_CAMERAS ; i++) 

45 XZl[i]=center-XZl[i] ; 

XZ2(i]=XZ2[ i J+center; 

} 

return ( Curve_Area ) ; 

) 

int f ind_3d_location ( cam_n , X_2d , Y_2d , x_3d , y_3d , z_3d , bndO , bndl , bnd2 , cam__dist ) 
float *x_3d,*y_3d, *z_3d; 
50 struct boundary_data *bndO , *bndl , *bnd2 ; 

int cam_n , *cara dist , X_2d , Y_2d; 



int xl [ N_CAMERAS ] , x2[N_CAMERAS ) , y [ N_C AMERAS ] , X, i, XZ1 [ N_CAMERAS } , XZ2 [ N_CAM 
XL1 [ N_C AMERAS ] , XL 2 [ N_C AMERAS ] ; 
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struct boundary_data *bnd; 
10 int j, center, indexfN CAMERAS] .cvnum, mi resize; 

float y_height, height, A"; 
switch (cam n) 
( 

case 0: bnd=bnd0; 

break; 
case 1: bnd=bndl; 
15 break; 

case 2: bnd°bnd2; 
break; 

if ((i=bnd->out_rect.yl)>Y_2d || Y_2d > bnd->out_rect .y2 ) 

if (debugflag) printf("\n WARNING 1: requested coordinats are out of sight f 

20 } 

min size=*f i nd_i ndex( index, Y 2d,bnd0,bndl ,bnd2,cam_n,bnd) ; 

xl[0J - SndO -> boundary[index(07] .xl; 

x2[0] «= bndO -> boundary [ i ndex[0] ] .x2; 

xl[l] « bnd] -> boundary[index[2] ] .xl ; 

x2[l] = bndl -> boundary[index[l]] .x2; 

xl[2] - bnd2 -> boundary[i ndex[Z] ] .xl ; 

x2[2] = bnd2 -> boundary[index[2j] .x2; 

25 for (i»0 ;i<N CAMERAS ; i++) 

( " 

if (index[i]<=l) 
{ 

index[i J==2; 

if (debug_flag) pr1ntf("\n WARNING 2: activate Y coordinate correcting") ; 

30 } * 

i f (index[0]>=bndO->boundary_i ndex-2) index[0]==bndO->boundary_i ndex-2; 
if ( i ndex[ 1 J>«bnd l->boundary_i ndex-2) i ndex[ 1 ] ==bndl ->boundary_i ndex-2 ; 
if (index[2]>=bnd2->boundary index-2) index[2]—bnd2->boundary index-2; 
if (X_2d <= xl[cam_n] || X_23 >= x2[cam_n]) 

if (debug_flag) printf("\n WARNING 3: activate X coordinate correcting"); 
35 X_2d - (X_2d <» xl[cam_n]> ? xl[cam_n]+2 : x2[cam_n]-2; 

A=compute_line_all (xl, x2, cam dist,XZl,XZ2,XLl,XL2); 

cv num=X_2d < XLl[cam_n] 1 0: X_2d < XL2[cam_n] ? 1 : 2; 
caTc_xz_coord (camj , X_2d , c v num, x_3d , z_3d , cam di st ) ; 
y_height=(*cam_di st+(*(cam_di st+1 ) )+ 

<*(cam dist+2)))*CCD_SIZE_Y/((float) CC0_RES0LUTI0N_Y*CAM_F0CAL LENGTH 
40 /* Coordinate Adjusting */ 

*x_3d= -(*x^3d); 

*y_3d=- y_heTght*(-min size/2. + index[cam n]-( (bnd->boundary index-min size)/2)l; 
if (XZl[cam_n] > X_2d~| | XZ2[cam_n] < X23 ) " " 

^ if (debugflag) printf("\n WARNING 4: out of sight limits (bndz)"); 

45 } return(O); 

double calc_bleniish_area(cam_n,Xs h.Ys h,Xs_l ,Ys_l ,bnd0, bndl ,bnd2, cam dist) 
struct boundarydata *bndO,*bndT,*bno r 2; 
int cam_n,*cam dist,Xs h,Ys h.Xs l,Ys 1; 



50 



{ 



float crd[4}[3J,a,b,c,d,f,p,Ar; 
float calc_sphr_di st() ; 
double DO; 

if (f ind_3dJocation(cam_n,Xs h, Ys_h, &crd[0] [0] , &crd[0] [ 1 ] , &crd[0] [2] , bndO, bndl , bnd2 , cam di 

< 0 ) return(-1.7; 

if (find_3d_location(cam n,Xs h,Ys 1 , &crd[ 1 ] [0] , &crd[l] [ 1] .&crd[ 1] [2] , bndO, bndl , bnd2 , cam di 

< 0 ) return(-l.); " 
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if (find_3dJocation(cam_n,Xs 1 , Ys_h,&crd[2] [0] , &crd[2] [ 1 ] ,&crd[2] [2] , bnd0,bndl , bnd2 ) cam_di 

< 0 ) return(-l .J; 

if (find_3d_location(cam_n,Xs 1 , Y$J , &crd[3 ] [0] , &crd [3] [ 1 ] , &crd[3] [2] , bndO , bndl , bnd2 , cam_ di 

< 0 ) return(-l .J; 
a=calc_sphr_dist(crd[0],crd[l]); 
b=calc sphr_dist(crd[l] ,crd[3]); 
c=calc sphr di st (crd[2] ,crd[3] ) ; 
d=calc~sphr_dist(crd[0],crd[2]) ; 
f=calc sphr_dist(crd[0],crd[3]); 

1S p-(a+b+f)/2. ; 

Ar«sqrt(p*(p-a)*(p-b)*(p-f)); 

if (errno==EDOM) printf( M \n SQRT ERROR : at calc blemish area"); 
p=(d+c+f)/2. ; 

Ar+=sqrt(p*(p-d)*(p-c)*(p-f)); 

if (errno==EDOM) printf("\n SQRT ERROR : at calc blemish area 2 M ); 
DD=(double)Ar; 
2Q return(DD); 

) 

make l i ne_drawing(xl , x2,xll,xl2, cam_dist, maskO, maskl, mask2, viewjieig) 

double view_heig; 
int *xl,*x2,*xll,*xl2,*cam dist; 
PIXEL maskO[FR_X_SIZE],maskllFR_X_SIZE] J mask2[FR_X_S 

25 * PIXEL *Ptr[N_CAMERAS] ; 

int i , cam, color, curve_num; 
int base_color; 

float x,z; 

Ptr[0]=maskO; Ptr[ l ]=maskl ; Ptr[2]=mask2 ; 
for (cam»0 ; cam<N CAMERAS ; cam+-r) { 

for (i = *(xl+cam) ; i<*(x2+cam) ; i+- DISPLAY_RESOLUTION) 
30 ( 

color=(*(Ptr[cam]+i )) ; 
if {color < 50 && color > 0) 
( 

curve_num=i < *(xll+cam) ? 0: i < "*(xl2+cam) 
calc_xz coord(cam, 1 , curve num,&x,&z,cam dist); 
fprintf(out_7ile, " %7.2f %7.2f X7.2f %2d %ld\n 

35 } 

} 

} 

return(SUCCESS); 

void imagin stem_calix coord(bndO,bndl ,bnd2 , North, South, camera_dist) 
struct boundary_3ata *bndO,*bndl ,*bnd2; 
40 float North[3],South[3]; 

int *camera_dist; 

int i ,j, center, XI [N_CAMERAS] , X2[N_CAMERA$] ; 

float x,y,z,y height, max height; 

int size[N_£AMERAS] ,dir"f [N CAMERAS], min y; 

if ( (size[0]=bndO->boundary_index) > (size[T]=bndl->bouno , ary_index) ) 
45 min_y=l; 

else min_y«0; 
if ( (si ze[2]»bnd2->boundary_index) < size[min_y]) 
min_y=2; 

di ff [(min_y+2)%3] = size[(min y+2)%3]-size[min_y] ; 

if ((diff[(min y+1 )%3]=si zeT(min y+1 )%3]-size[mi n y]) > SIZE BND DIFF LIMIT 
diff[Tmin y+2)%3] > SIZE_BND DIFF LIMIT)"" { ~ ~ 

50 if (debug_Tlag) printf("\n WERNINE 5: Boundary structurs sizes are no 

.} 

di ff [min y]=0; 

for (i=0~; i < N CAMERAS ; i++) { 
if (sizefi ]==0) continue; 
diff[i]/=2; 
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y height=(*camera di st+(*(camera dist+l))+ 
" (*(camira_dist+2)))*CCD_SlZE_Y/((float) CCD_RES0LUTI0N_Y*CAM_FOCAL 

max height=y height*size[min_y]/2.+y_height ; 
" center=FR_X_SIZE/2; 

Xl[0]=center-bndO->boundary[diff[0]] .xl; 

X2[0]=bndO->boundary[diff[0]] .x2-center; 

Xl[l]=center-bndl->boundary[diff[l]] -xl ; 

X2[ l]=bndl->boundary[di f f [1 ] ] .x2-center; 

Xl[2]=center-bnd2->boundary[diff[2]].xl ; 

X2[2]=bnd2->boundary[diff[2]3.x2-center; 
calc_line(Xl[0],X2[O] 1 Xl[13,X2[l],Xl[2],X2[2],camera_dist); 
find pol igon_mean(South) ; 
SoutK[l]=max height; 

Xl[0>center-bndO->boundary[size[min y]+di f f [0]- 1] .xl ; 

X2[0]=bnd0->boundary[size[min_y]+difT[0]-l].x2-center; 

Xl[l]=center-bndl->boundary[siz9[min y]+di f f [ 1 ]-l ] .xl ; 

X2[l]=bndl->boundary[size[min_y]+difT[l]-l].x2-center; 

Xl[2]=center-bnd2->boundary[size[min y]+di ff [2]-l] .xl; 

X2[2]=bnd2->boundary[size[min_y]+dif7[2]-l].x2-center; 
calcJine(Xl[0],X2[0] ? Xl[l],X2[l] f Xl[23,X2[2],camera_dist); 
find pol igon_mean(North) ; 
Nortfi[l]=-max_height +3 .*y_height; 

id val idate_in_pic(cx,cy,dcx,dcy,bnd, index) 
int *cx,*cy,*dcx,*dcy, index; 
struct boundary _data *bnd; 

int j,i,d,dx,dy; 
dx=*dcx; dy«*dcy; 

/* Adjust the central pixel so all the squar will be inside the bnd line frame */ 
while (*cy-dy <» bnd->boundary [0] .y+2) (*cy)++; 

while (*cy+dy >= bnd->boundary [bnd->boundary index-1 ] .y-2) (*cy)--; 

while (Cbnd->boundary[(*cy)-dy].x2-bnd->boun3ary[(*cy)-dy].xl < 2*dx-2) H 

(bnd->boundary[(*cy)+dy].x2-bnd->boundary[(*cy)+dy].xl < 2*dx-2) ) 

if (dx>9) dx— ; 

else *cy=(*cy > FR_Y_SIZE/2)?(*cy)-l : (*cy)+l ; 
} 

for (i=0;i<MAX BOUNDARY; i++) 

if (bno r ->boundary[i] .y==*cy) break; 
if { i ==MAX_BOUNDARY ) { 

printf("\n ERROR : Cant find line"); 

exit(O); 

/* for apper left corner */ 
d - (*cx)-dx - (bnd->boundary[i-dy] .xl+2) ; 
if (d < 0) 

if (debug flag) printf("\n Counted Apper left cor", index); 
for (j = i-(Jy+l ; j<i+2*dy+2; j++) 

if ((*cx)-dx - (bnd->boundary[j] .xl+2) > 0) break; 
if (d > i-dy-j) *cx-«d; 
else *cy-=i-dy-j; 

/* for lower left corner */ 
d = (*cx)-dx - (bnd->boundary[i+dy] .xl+2) ; 
if (d < 0) 

if (debugflag) printf("\n Count=%4d Lower left cor", index); 
for (j = i+dy-l; j<i-2*dy-2; j— ) 

if ((*cx)-dx - (bnd->boundary[j].xl+2) > 0) break; 
if (d > j-i-dy) *cx-=d; 
else *cy-=j-i-dy; 
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} 

d » (*cx)+dx - (bnd->boundary[ i-dy] .x2-2) ; 
if (d > 0) 

if (debug flag) printf("\n Count=%4d Apper write cor", index); 
for (j=i-dy+l ; j<i42*dy+2; j++) 

if ((*cx)+dx - (bnd->boundary[ j] .x2-2) < 0) break; 
if (d < j-i+dy) *cx-»d; 
15 else *cy-=i-dy-j; 

/* for lower write corner */ 
d - (*cx)+dx - (bnd->boundary[i+dy].x2-2); 
if (d > 0) 

if (debug flag) printf("\n Cuont=%4d Lower write cor n , index) ; 
on for <j-i+dy-l; j<i-2*dy-2; j — ) 

if ((*cx)+dx - (bnd->boundary[j].x2-2) < 0) break; 
if (d < i+dy-j) *cx-=d; 
else *cy-»j-i-dy; 
} 

*dcy=dy ; 
*dcx«dx; 

25 double calc_area_ratio(cam,x,y,pix_area,bnd0.bndl ,bnd2, cam dist, index) 
int *x, *y, cam, *cam_dist, index, pixarea; 
struct boundary_data *bnd0,*bndl,*bnd2; 

{ 

int dx,dy; 

doubl e ar; • j 
ar= (double) pi xarea; 
30 ar-sqrt(ar); 

if (errno==ED0M) printf("\n SQRT ERROR : at calc area ratio "); 
1f((dy»dx=(int) ar/2. - 0.5)<=0) { 

dx-1; 

dy=l; 

} 

1f (cam==0) validate in_pic(x,y,&dx, &dy, bndO, index) ; 
35 if (cam— 1) val idate~in_pic(x,y,&dx,&dy,bndl, index) ; 

if (cam— 2) validate in_pic(x,y,4dx,&dy,bnd2, index) ; 

ar=calc_blemi shareaXcam, *x-dx,*y-dy,*x+dx,*y+dy,bndO,bndl ,bnd2,cam dist) ; 
if (debug flag) printf("\n 5) AR-%7 . 2f " , ar) ; 
ar/=Tdouble)(2*dx)*(double)(2*dy); 
if (debug flag) printf("\n Area_Ratic=*7 . 2f " , ar) ; 
return(arj; 

} 

40 ^define Cam_dist 800. 

fi*define Eps le-10 

^define NUM_STEPS 16 

^define pi 3.14159265359 

^define TAN60 1.7320508 

^define TAN180 0. 

^define TAN300 -1.7320508 
45 Sundef FALSE 

#undef TRUE 

enum boolean { FALSE, TRUE }; 
float calc di stance() ; 
float Tg()T 
f 1 oat cal cproject i on ( ) ; 
static struct linesf 

float tg[6]; 
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}Cam 1 ines; 

static struct points{ 



float offset[6]; 
float FJLx[6],F_K_y[6]; 
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float mid_x[6],mid_y[6]; 

} Poligonpts; 
f0 static float recons pts[6][NUM STEPS][2]; 

float AREA; 
float Are; 

static float CamAngel s[N_CAMERAS]» { 3.*pi/2. , 5.*pi/6. , pi/6. }; 

static float pixel_size; 
dobezierinterp(fact) 
float fact; 

15 { 

int i ; 

for (i-0; i<6 ) 
calc bezier curve(fact ,Pol igon pts .mid_x[ i J , Pol i gon_pts .mid y[i], 

Poligon pts.F K x[ (i+1 )%6] , Pol igon pts.F K y[(i+l)%6], 
Po1igon"pts.F~K_x[(i+l)%6],Poligon_pts.F"K"y[(i+l)%6], 
Pol 1 gon_pt s . mi d_x [ ( i + 1 ) 9£6 ] , Pol i gon pt s . mTd_y [ ( i + 1 ) %6 ] , &recons_pt s [ i ] [ 0 

20 ) 

calc bezier_curve(factor,Pl_x,Pl_y,P2_x,P2 y , P3_x , P3_y , P4 x,P4 y.Pts) 
float f actor, Pl_x,Pl_y f P2_x,P2_y l P3_x,P3_y,P4_x f P4_y,*Pts;~ 

{ 

float t, delta, mult-1.; 
int index; 

t=del ta=l . /{mul t*NUM_STEPS) ; 
2« P2 x=factor*(P2 x-Pl x)+Pl x; 

P2>«factor*(P2~y-Pl"y)+Pl~y; 
P3_x=f actor* ( P3_x-P4_x)+P4_x ; 
P3 y=factor*(P3 y-P4 y)+P4 y; 
*Pts=Pl x; 

*(Pts+lT=Pl y; . 
for (index=7; index < mul t*NUM_STEPS; index++) { 
30 *(Pts+(index«l))=Pl x*pow(l-t,3.)+3 .*P2 x*t*pow(l-t,2)+3.*P3 x*t*t*(l-t)+P4 x 

*(Pts+l+(index«l))=Pl_y*pow(l-t,3.)+3.*P2_y*t*pow(l-t,2)+3.*P3 y*t*t*(l-t)+P4 
t+=delta; 

} 

} 

void calc points() 

{ 

int i ; 

float calc_point_y(int v, 1nt j); 
float calc_point x(int i.int j); 
Pol igon pts. F_K_x[0l-calc_point_x(2,5) ; 

PoTigon pts . F_K_y[0]=cal c_poi nt_y(2, 5) ; 
Pol igon pts.F_K_x[l]=cal c_point_x(l ,2) ; 

PoTigon pts.F_K_y[l]=calc_point y(l,2); 
Pol igon pts.F_K_x[2J=calc_point_x(4,T) ; 

PoTigon pts . F_K_y[2]=calc_point_y(4, 1 ) ; 
Pol igon pts.F_K_x[3]-calc_point_x(3, 4) ; 

PoTigon pts. F_K_y[3]=calc_point_y(3,4) ; 
Pol igon pts.F_K_x[4]«calc_point_x{0,3) ; 

PoTigon pts.F K_y[4]»calc_point_y(0,3) ; 
Pol igon pts .F_K_x[5]=calc_point_x(5,0) ; 
45 PoTigon pts.F K y[5]=calc point y(5,0); 

for (i=5;i<6;T++) { 
Poligon pts .mid_x[ i ]=(Pol igon pts . F_K_x[i ]+Pol igon pts.F K_x[ ( i+1 )%6] ) /Z . ; 

Poligon_pts.mid_y[i7=(Poligon_pts.F_K_y[T}+PolTgon pts.F_K_y[(i+l)%6])/2. ; 

} 

float calc_point_x(i , j) 
50 ^ int i,j; 

ret urn(<CamJ ines. off set [i]-Cam_l ines .offsetfj ] )/(Cam_l i nes . tg[ j ]-CamJ ines . tg[i ] ) ) ; 

float calcpoint y(i,j) 
int i,j; 
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( 

10 return((Cam 1 ines. tg[i]*CarnJ ines. off set[j]-Cam_l ines. tg[j}*Cam lines. offsetfi J)/(Cam lines 

} 

float calc di stance(xl ,y] ,x2,y2) 
float xT.yl ,x2,y2; 

{ 

if (fabs(xl-x2)<Eps) return(fabs(yl-y2) ) ; 
if (fabs(yl-y2)<Eps) return (fabs(xl-x2) ) ; 
15 return(sqrt(pow(xl-x2,2.)+pow(yl-y2,2.)>); 

if (errno«EDOM) printf("\n SQRT ERROR : calc distance"); 

float calc sphr_dist(crdl ,crd2) 
float *crdl,*crd2; 

( 

float tmp; 

tmp=pow(*crdl-(*crd2) ,2. ) ; 
20 tmp+=pow(*(crdl+l)-(*(crd2+l)),2.); 

tmp+=pow(*(crdl+2)-(*(crd2+2)),2.); 
tmp=(float)sqrt(tmp); 

if (errno==ED0M) printf("\n SQRT ERROR : at calc_sphr_di st") ; 
return(tmp) ; 

} 

calc 1 ine(xal,xa2,xbl,xb2,xcl 1 xc2,cam dist) 
25 Tnt xal,xa2,xbl,xb2,xcl,xc2; 

int *cam_dist; 

{ 

float alpha a, beta a,alpha_b t beta_b,alpha_c,beta_c; 

static int fTag=FAL?E; - - 

int i ; 

if (flag— FALSE) { • - v . 

3^ flag=TRUE; 

pixel size-CCD SIZE X/(float) CCD RESOLUTION X; 
} ~ " 

Cam_lines.tg[0]= (xal != 0)?CAM_FOCAL LENGTH/ (pixel size*xal ) : FLT MAX; 
Cam lines. tg[l]—((xa2 !- 0)?CAM_F0CAL LENGTH/ (pixel s ize*xa2) : FLT MAX7; 
alpKa_a=atan( pixel_size*xal/(float) CRM_F0CAL LENGTH); 
beta_a =atan( pixel_size*xa2/(float) CAM_FOCAL~"LENGTH) ; 
alpha b=atan( pixel size*xbl/(f loat) CAM FOCAL~LENGTH) ; 
35 beta_b~ »atan( pixel size*xb2/(f loat) CAM FOCAL LENGTH); 

alpha c-atan( pixel_size*xcl/(float) CAM~FOCAL~LENGTH) ; 
beta c =atan( pixel si ze*xc2/(f1 oat ) CAMFOCAL^LENGTH) ; 
Cam Tines .tg[2]=tanX5.*pi/6.-alpha_b) ; 
Cam_l ines . tg[3]=tan(5*pi/6.+beta_b) ; 
Cam 1 ines . tg[4]=tan(pi/6.-alpha_c) ; 
Caml ines. tg[5]=tan(pi/6.+beta_c) ; 
40 Cam_lines.offset[0]=-(float) *cam_dist; 

Cam_l ines.offset[l]«-(float) *cam dist; 

CamJ ines .off set [2]=-(*(cam_3ist+l))*sin (alpha b)/sin(pi/3 .-al pha b) ; 

Cam! ines. offset[3]= (*(cam_dist+l))*sin(beta_E)/sin(2*pi/3.-beta b) ; 

Cam_l ines.offset[4]» (*(cam dist+2))*sin(alpha_c)/sin(2*pi/3.-alpHa c); 

Cam_l ines. offset [5]— (*(cam~di st+2) )*sin(beta_c) /sin (pi /3.-beta_c) ; 

calc_points{ ) ; 

45 *undef A 
#undef B 

calc perpend icular (A ,B, Ix, ly,0x,0y) 
float A,B,Ix,Iy,*0x,*0y; 

{ 

float Ap.Bp; 
Ap=(fabs(A)>Eps)?(-l/A):FLT MAX; 
50 Bp-Iy-Ix*Ap; 

*0x«<Bp-B)/(A-Ap); 
*0y=(A*Bp-Ap*B)/(A-Ap); 
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calccurves projecti ons (camdi st , xl 1 ,xl2) 
10 int *xlT,*xl2,*cam_dist; 

float 11,12; 

int i , cam, center; 
center=FR_X_SIZE/2; 

for (cam=0 ; cam<N_CAMERAS*2 ; cam+=2) { 

12=calc_projection(Poligon_pts.mid x[cam] , Pol igon_pts .mid_y[cam] , 
cam/2, *(cam_dist+cam/2) ) ; 

15 U=-calc_projection(Pol igonpts .mid_x[ (cam+5)%6] , Pol igon_pts.mid_y [ (ca 

cam/2, *(cam_di st+cam/2) ) ; 

12=12/pixel_size; 
11=U/pixel size; 

*(xl2+cam/2T=center+(int) (1 2+SGN(l 2)*0 . 5) ; 
*(xll+cam/2)=center-(int) (1 1+SGN(1 1)*0.5) ; 

20 , > 

calc_xz_coord(cam 1 1 ine pi x, curve, x,z,cam_dist) 
int cam, curve, lTne_pix,*cam_di st; 
float *x,*z; 

int index, p,k, center, jump_size,l ; 
float p x,p_y,k x, k_y,*P, tmp; 
25 jump_size=NUM_STEPS; 
1=0, index; 
center-FR X_SIZE/2; 
P»recons_pts[0] [0] ; 
curve=((cam«l )+4+curve)X6; 
while (abs< jump_size)>l) { 
j ump_si ze= jump_si ze/2 ; 
30 l=l+jump size; 

index=curve*NUM_STEPS+l ; 
p_x«*(P+(index«l)); 
p_y=*(P+l + (index«l )) ; 

tmp=calc_projection(p x,p_y, cam, *(cam_dist+cam) ) ; 
p=center + (int) (tmp7pixel_size +SGN(tmp)*0. 5) ; 
jump size-SGN_0(l ine_pix-p)*abs( jump_size) ; 

35 ) 

if (jump size!=0) { 

index=(curve*NUM_S7EPS+l+jump_size)%(NUM_STEPS*6); 

k x-*(P+(index«i)) ; 

k~y«*(P+l + (index«l)); 

tmp=calc_projection(k_x, k_y ,cam,*(cam_di st+cam) ) ; 
k=center + (int) ( tmp/pi xel_size + SGN(tmp)*0.5) ; 
*x=-((p x-k x)*(line pix-k)/( (fl oat) (p-k)) +k_x); 
40 "*z=-((p y-k_y)*(line_pix-k)/((float) (p-k)) +k_y); 

return(fi) ; 

) 

*x=-p_x; 
*z=-p_y; 

calc sight limits(cam dist,xzl ,xz2) 
45 iHt *cam_di st,xzlTN_CAMERAS] ,xz2[N_CAMERAS] ; 

f 

void cam_sight_l imi ts() ; 
int i ; 

cam_sightJimits(&xz2[0],&xzl[l],TAN300,0,cam_dist); /* 0 for curve FG-GH */ 
cam sight 1 imits(&xz2[l] ,&xzl [2] ,TAN180, 2,cam dist); /* 2 for curve HI-IJ */ 
cam~sight~limits(&xz2[2],&xzl[0],TAN60, 4, cambist); /* 4 for curve JK-KF * 

50 } 

void cam_sight_l imi ts(xz2 ,xzl , angle, num,cam_di st) 
int *xz2,*xzl ,num,*cam_dist; 
float angle; 

t 
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float *P.zl,z2: 
int i,cam; 
10 P=recons pts[0][0J; 

i=num*NUR STEPS + (NUM_STEPS»1) ; 
. if (Tg(i.P) > angle) 

while(Tg(++i,P)>angle && i<6*NUM_STEPS) ; 

el se 

while(Tg( — i,P)<angle && i>-l); 
if (abs(i-num*NUM_STEPS-(NUM STEPS»1)) > (NUM_STEPS»1 ) ) { 
15 i=num*NUM_STEPS + (NUM STE?S»1); 

printf("\n WARNING : not a normal curve "); 

} 

cam=num/2 ; 

z2= calc_projection(*(P+(i«l )) , *(P+l + ( i«l )) ,cam,*(cam_dist+cam) ) ; 
zl=-calc_projection(*(P+(i«l)) ,*(P+l+(i«l) ) , (cam+l)%3 ,*(cam di st+(cam+l)%3) ) ; 
*xz2=z2/pixel_size+SGN(z2)*0.5; 
20 *xzl-zl/pixel_size+SGN(zl)*0.5; 

; 

float calc projection^, Y,cam no,dist) 

float X,Y; 
int di st ,cam no; 
{ ~ • «. 

int center; . " - 

25 float Ox, Oy, length, xz; 

rotation(3*pi/2-Cam Angelsfcam no] ,X, Y,&Ox, &0y) ; 

xz=-Ox*CAM_FOCAL_LERGTH/(dist+Dy); ... 
return(xz); 

.float Tg(i,P) . v 

int i; 
30 float *P; 

( 

return( ((*(P+((i+])«l)+l))-(*(P+(i«l) + l)))/((*(P + (( 1+1 )«l)))-(*(P +( i«l ))))) ; 

calc area (AREA) 

double *AREA; 

( 

35 Int i; 

int mult«*6; 
float temp=0,*pts; 
pts»recons_pts[0] [0] ; 
Are=0.; 

for (i*0;i<6*NUM STEPS-l;i++) { 
temp+-(*(pts+((i + l7«l)))*(*<pts+l+(i«l)))-(*(pts+(1«l)))*(*(pts+l + ((i+l)«l))); 
40 } 

temp+=(*pts)*(*(pts+l + (i«l)))-(*(pts+(i«l)))*(*(pts+l)); 
*AREA=temp/2 . ; 

} 

rotation(alpha,X,Y,new_x,new_y) 
float alpha, X, Y,*new_x,*new_y; 

45 static float aph=0. ,mx_trn[2] [2] ; 

if (fabs(alpha-aph)>Eps) { 
aph»alpha; 

mx_trn[0] [0]=cos(aph) ; 

mx_trn[0][l]=(aph>pi)?sqrt(l-mx trn[0] [0]*mx trn[0] [0] ) :-sqrt (1-mx trn[0]fO]*m 
if (errno-=E00M) printf("\n SQRT ERROR : rotation^); ~~ 
mx_trn[0][2]=0. ; 
50 mx_trn[l ] [0]=-mx_trn[0] [1 ] ; 

mx trn[l][l]=mx_trn[0][0]; V 
mxj:rn[]][2]=0.7 

*new_x=mx_trn[u][0]*X + mx_trn[0] [ 1 ]*Y ; 
*new_y=mx_trn[l][0]*X + mx_trn[l] [ 1 ]*Y ; 
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15 



20 



25 



30 



35 



40 



45 



50 



return(O) ; 

int f ind_ index ( i ,y, bndO,bndl , bnd2 , cam, bnd) 
int *i,y,cam; 

struct boundarydata *bndO, *bndl , *bnd2 , *bnd; 



{ 



} 



int size[3] ,diff[3], count, min,j; 
size[0]«bndO->boundary_index; 
si ze[ l]«bndl->boundary_i ndex; 
size[2]«bnd2->boundary_index; 

di ff [(canH-2)%3] = (size[(cam+2)5S3]-size[caiTi])/2; 

diff[(cam+l)%3]«(size[(cam+l)%3]-size[cam])/2; 

diff[cam]»0; 

min=bnd->boundary[0] .y; 

count=0; 

do 

{ 

if ( ( j"=y-bnd->boundary[y-min] .y) > 0) min++; 

else if (j<0) min— ; 

count++; 

} 

while (j!-0 && count<100 ); 
if (count>=100) 

( 

printf("\n ERROR : cannot find y line in boundary struct 

exit(O); 

} 

for <j=0;j<N CAMERAS 

*(i+J)«y-min+diff[j]; 
return(MIN(MIN(size[0],size[l]),size[2])); 



); 



double 

{ 



angle_between_n(xl,yl,zl ,x2,y2, z2, length) 

double xl,yl,zl,x2,y2,z2,*length; 



double p] , p2,p3,p4,p5,p6,p7,cosg,g; 
pi - xl * x2; 
p2 = yl * y2; 
p3 « zl * z2; 

p4 - xl*xl + yl*yl + zl*zl; 
p5 = x2*x2 + y2*y2 + z2*z2; 
p6 = pl+p2+p3; 
p7 = sqrt(p4) * sqrt(p5) ; 
if (errno— EDOM) 
{ 

printf("\n SQRT ERROR 
errno=0; 
} 

cosg = p6 / p7; 

if (cosg > 0.999) cosg = 0.999; 

if (cosg < -0.999999) cosg = -0.999999; 

g = acos(cosg) ; 

*length=sqrt (p4+p5-2*p7*cosg) ; 
if (errno==EOOM) 
( 

printf(*\n SQRT ERROR : at angle between 2"); 
printf( n \n xl»%7.3f yl=%7.3f zl=%7.3f x2=%7.3f 



at angle between 1"); 



} 



printf("\n pl=%7.3f 
errno=0; 
} 

return(g) ; 



y2*%7.3f z2=%7.3f \xl,yl, 
p4=%7.3f p5=%7.3f p7-%7.3f cosg«%7.3f\pl,p4,p5,p7,cosg) 



find poligon mean(Pole) 
fToat *Pole; 

{ 
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int i ; 
*Po1e=0. ; 
*(Pole+2)=0. ; 
for (i=0 ; i<6 ; 



{ 



15 



*Pole+=Poligon pts.F K x[1]; 
*{Pole+2)+=PolTgon_pts.FJ<_y£i]; 



*Pole/=-6. ; 
*(Pole+2)/=-6. ; 

float calc di ameter(vol ) 
douEle vol; 

float factor=l.; 

return (2 .*pow(factor*vol *3 . /(4 .*pi ) ,0.33333) ) ; 



static unsigned long apt address = 0; 

static unsigned char quiet; 

static 

report_error(int err, int where) 
{ 

char str[80]; 

if (quiet) return(l); 
strcpy(str, "*** Extended memory (XMS) error: "); 
switch (err) 
( 

case 0x80: strcat (str, "Function not implemented"); break; 

case 0x81: strcat (str, "Vdi sk was detected"); break; 

case 0x82: strcat (str , "A20 Error"); break; 

case OxAO: strcat (str, "No room in extended memory"); break; 

case OxAl: strcat (str, "Out of extended memory HANDLES") ; break; 

case 0xA2: strcat (str, "Attenpt to free invalid handle"); break; 

case OxAB: strcat (str, "HANDLE is locked"); break; 

case 0xA3: strcat (str, "Source Handle is invalid"); break; 

case 0xA4: strcatjstr, "Source Offset is invalid"); break; 

case 0xA5: strcatjstr , "Dest Handle is invalid"); break; 

case 0xA6: strcatjstr , "Dest Offest is invalid"); break; 

case OxA7: strcat(str, "Length is invalid"); break; 

case 0xA8: strcat(str, "Move has invalid overlap"); break; 

case 0xA9: strcat(str, "Pari ty error has occured"); break; 

default: strcat(str, "Unrecognized XMS error"); break; 

printf("\n%s",str); 

strcpy(str," Error detected by: "); 

switch (where) 

{ 

case 1: strcat(str, "malloc_extended") ; break; 
case 2: strcat (str, "free_extended" ) ; break; 
case 3: strcatjstr , "xms mem move"); 
default: strcatjstr, "Anonymos routine"); break; 

printf ("\n%s",str); 
exit(l); 

) 

free extended(unsi gned int handle) 

[ 

unsigned 1nt r; 
unsigned char err; 
_asm \ 



( 



50 



mov 
mov 



call 



ah, OAh 
dx, handle 
[api_address] 
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} 



mov 
mov 



err, bl 



if (r == 0x0001) return{l); 
else { 

report error(err,2) ; 
returnlO); 

} 

malloc_extended(unsigned int Kbyte_size) 

unsigned int kbytes = Kbyte_size; 

unsigned int r, handle; 

unsigned char err; 
asm \ 



{ 

mov 
mov 
call 
mov 
mov 
mov 

} 

if (r 
else { 

report error(err , 1 ) ; 

returnXO) ; 

} 



ah, 09h 
dx, kbytes 
[api_address] 
r, ax 

handle, dx 
err, bl 

0x0001) . return(handle) ; 



} 

xms_get_free(int *largest) 

( 

int r,rl; 
asm \ 
{ 



mov 
call 
mov 
mov 



ah, 08h 
[api_address] 
r, dx 
rl, ax 



} 



"Margest = 
return(r) ; 



rl; 



xms_version() 

{ 

int r; 
asm \ 
{ 

mov 

call 

mov 

) 

return(r) ; 



ah. OOh 
[apiaddress] 
r , ax 



is xms (qui etmode) 
r ~ 

unsigned char r; 

quiet - (char) quietmode; 
asm \ 

{ 

mov ax,4300h 
int 2Fh 
mov r,al 



;get XMS Number 



;get XMS Number 



} 

if (r == 0x80) 
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asm \ 

mov ax,4310h 
int 2Fh 

mov word ptr [ap?_address] ,bx 

mov word ptr [ api address+2] ,es 

} 

return(l); 

} 

else return (0); 

xms_mem_move( unsigned 1nt dst_handle, void far *dst, unsigned long bytes, 
unsigned int src handle, void "far *src) 

{ 

20 int r; 

unsigned char err; 
struct { 

unsigned long bytes_count; 

unsigned int src handle; 

void _far *src offset; 

unsigned int (Jst handle; 

void _far *dst_ofTset; 
25 } emras, *addr; 

addr - &emms; 
emms .bytes_count = bytes; 
emnis.src_handle = src_handle; 
emros.src offset » src; 
emms.dsOiandle = dst_hand1e; 
emms.dst_offset = dst; 

30 asm \ 

" ( 



push 


si 


push 


ds 


Ids 


si, addr 


mov 


ah, OBh 


call 


[api address] 


pop 


ds 


pop 


si 


mov 


r, ax 


mov 


err, bl 



35 

} 

if (r « 0x001) return(l); 
else { report_error(err,3) ; 
return(O) ; 

40 > } 

copy_to_xms(buf , length, handle) 

void _far *buf; unsigned long length; int handle; 

unsigned int kbytes = (length » 10) + 1; 
int ret; 

if (handle — 0) { 
45 handle - malloc_extended(kbytes) ; 

if (handle « 0) return(O); 
} 

ret « xms_mem_move(handle, OL, length, 0, buf); 
if (ret) return(handle) ; 
el se return(O) ; 

) 

50 copy_from_xms(buf , length, handle) 

void far *buf; unsigned long length; int handle; 

int ret; 
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ret = xms_mem_move(0, buf, length, handle, 01); 
if (ret) return(handle) ; 
el se return(O) ; 

} 

rdefine DELAY 16ms BY COUNTER 
rdefine 010 CUOCK PERIOD 10 
^define DIO~BASE ADDRESS Ox2AO 
*define DIOCOUNTERO (DI0_BASE_ADDRESS+4) 
IS ^define DIO C0UNTER1 (DI0_BASE_ADDRESS+5) 

^define DIO'CONTROL (DI0_BASE_ADDRESS+7) 
grab_nioving_apple(timel , time2, sensor) 

unsigned short timel, time2; 

{ 

int ret; 
Fifdef _CFG 
20 if (sensor) 

timel » getdel ay_from_sensor() ; 
cfgxtrigger(OFF) ; 

init_dio_trigger(timel , time2); /* time in ms */ 

init_triggered grab(); 

wa1t_trig(); 

ret « wait_trig(); 
if (ret == 0) return(O); 
25 cfg_xtrigger(OFF) ; 



45 



#endif 



speaker_beep(400, 200, 100, 1); 
speaker beep(300, 200, 0, 1); 
return (T) ; 



) 

init triggered grab() 

30 i ~ 

fifdef CFG 
int field; 

cfg sync(PLL) ; 

cfg videosync(EXTSYNC); 

cfg trigpl(HIGH); 

do { 

field - cfg field(); 
35 ) while (field I- 0);~ 

cfg xtrigger(ON) ; 
shao r ow_snap_cfg(0) ; 

send if 

} 

wait trig() 

{ " 
40 f?ifdef_CFG 
char status; 

cfg waitvb() ; 

whiTe (((status = inp(0x340 + 4)) & 0x08)) 

if (kbhit()) return(O); 
return(l) ; 

#endi f 
} 

test_trigger( ) 
( 
) 

init_dio_trigger(timel, time2) 

unsigned int timel, time2; 

{ 

unsigned port; 
50 unsigned char itimlO, itim20; 
unsigned short int timl; 

unsigned int divider * 1000 / DIO_CLOCK_PERIOD; 

port = DI0_BASE_ADDRESS; /+ I/O board base address */ 
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timl = timel * divider; /* ms in umits of 100 micro-seconds (lOus clock 

itimlO - (unsigned char)(timl » 8); /* counter MO high byte */ 

itim20 » (unsigned char)(timl & OxFF); /* counter #0 low byte */ 
outp (D10_CONTR0L, 0x3A); /* load control byte 0 0 1 1 1 0 1 0 - mode 5 */ 

outp (DIO COUNTERO, itim20); /Moad counterO */ 

outp (DICf COUNTERO, itimlO); 
timl - time2 * divider; 

itimlO - (unsigned char) (timl » 8); /* counter #1 high byte 

itim20 - (unsigned char) (timl & OxFF); /* counter #1 low byte 



} 



outp(DIO CONTROL, 0x7A) ; 
outp (DIO COUNTERl , itim20); 
outp (DI0~C0UNTER1, itimlO); 
return(SUCCESS); 



load control byte 0 
/*load counterl 



1 1 

7 



110 10 



V 

*/ 

mode 5 



' 4" 



get delay from sensor () 
{ " 

unsigned char c; 
double speed, t; 
fFdefine DIST 0.045 

c - (inp(DIO BYTEO) & OxFF); 

speed - 82./"Cdouble)c; 
• t - 1000. * DIST / speed; 

return((int)(t+0.5)); 

} 

#define MAX ARGS 
#define NAM! MAX -32 
^define R LOU DAC LIM 
^define R_HIGfl DAC LIM 
^define 6_L0W DAC UlM 
#define G_HIGH DAC_LIM - 
#define B LOWJJAC LIM 
^define B~HIGH DAC LIM 
^define APPLE TRAVlL INTERVAL 
#define FRAME TIME INTERVAL 
^define OPTICAL DISTANCE CAMERA 1 1870 
^define 0PT1CAL~"DISTANCE~CAMERA~2 1871 
^define 0PTICAL~DISTANCE~CAMERA_3 1872 
^define SYSTEM COMMAND 30FILE 1688 

process_comman3_file(fTle_name, prog_consts, settings) char file_name[]; 

struct prog_settings *prog consts; 



1788 
1834 
1777 
1823 
1772 
1818 



1635 
1469 



{ 

char 
int 
int 
FILE 



struct setupdata *settTngs; 



new_l ine; 

1 ine_counter - 

i, sum, index, 

r in_fp; 



0, ret; 
arg_c; 



/* input line counter */ 



char command[80] ; 
char arg v [ MAX_ARG S ] [ N AM E_MAX ] ; 

Tnit program(progconsts) ; 

if (Tin fp - fopen(file_name,"r")) == 0) { 

fprintf(stderr, "Can't find input file M ); 
exit(l); 

while (fscanf ( infp, "%[ *\n]%*[\n] command) != EOF) 

sum " compute_index(command t &i ) ; 
arg^c = separate_args (command, arg_v) ; 
switch (sum) 

{ 

case SYSTEM_C0MMAND_3D_FI LE : 

if (strchr(arg_v[l]+l, ■ ) != NULL) 

*strchr(arg_v[l]+l, •"■) = '\0 
settings->demo_file_command ■» strdup(arg v[l] + 
break; 
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FRAME TIME INTERVAL: 



R LOW DAC LIM: 



R HIGH DAC LIM: 



G LOW DAC LIM: 



G HIGH DAC LIM: 



B LOW DAC LIM: 



B HIGH DAC LIM: 



default: 



prog_consts->f rame_time_interval = atoi(arg v[ 
settings->frame_time_interval - atoi <arg_v[T] ) 
break; 

prog consts->dac_low_l im[CAM I] = atoi(arg v[l 
settTngs->dac_")ow_l im[CAM_l] » atoi (arg_v[T] ) ; 
break; 

prog consts->dac_high_l im[CAM_l ] = atoi(arg_v[ 
set tings- >dac Jngh Jim[CAM_lj = atoi (arg v[l]) 
break; 

prog consts->dac_low_l im[CAM_2] = atoi(arg_v[] 
settTng$->dac_low_lim[CAM_2] = atoi (arg_v[l ] ) ; 
break; 

p.rog_consts->dac_high_l im[CAM_2] = atoi (arg v[ 
settings->dac_high_l im[CAM_2] = atoi (arg_v[T] ) 
break; 

prog consts->dacJow_lim[CAM_3] = atoi(arg_v[l 
settTngs->dac Jow_l im[CAM_3] » atoi (arg vfl ] ) ; 
break; 

prog consts->dac_high_lim[CAM_3] - atoi (arg v[ 
settTngs->dac_highJ im[CAM 3] = atoi (arg v[Tl) 
break; ~ . 

APPLE_TRAVEL_INTERVAL: 

prog^consts->apple_travel_time_interval » atoi 
settTngs->appl e_travel_time_interva*l = atoi(ar 
break; 

0PTICALJDISTANCE_CAMERA_1: 

prog_ r Consts->camera_di stance [CAM_1] = atoi (arg 
settTngs->camera_distance[CAM_l] = atoi (arg v[ 
break; 

OPT I CALD ISTANC E_CAMERA_2 : 

prog consts->camera_di$tance[CAM_2] = atoi (arg 
settTngs->camera_distance[CAM_2] = atoi (arg v[ 
break; 

0 PT I C A L_D 1 STANC ECAME R A_3 : 

prog_ j Consts->camera_distance[CAM_3] = atoi (arg 
settTngs->camera_distance[CAM_3] = atoi(arg_v[ 



} /* of switch 
} /* of while */ 
fclose(infp) ; 
return(l) ; 

} 

show_setup (settings) 

struct setup data 



break; 

printf ("\n%s 
break; 



%d'\arg_v[0], sum); 



'settings; 



printf("\n R_Low dac lim: 
printf("\n RHigh dac lira: 
printf("\n Glow dac lim: 
printf("\n GHigh dac lim: 
printf("\n BLow dac lim: 
printf("\n B_High dac lim: 
printf("\n Cam 1 Optical distance: 
printf("\n Cam 2 Optical distance: 
printf("\n Cam 3 Optical distance: 



%3d" ,settings->dac_low lim[CAM 1]); 
%3d",settings~>dac_higH lim[CAR 1J); 
%3d'\settings->dac_low TimfCAM ?]); 
%3d' , ,settings->dac_higf> 1 im[CAR_2]j ; 
963d",settings->dac_lowJ"im[CAM 3]) ; 
%3d",settings->dac high lim[CAR 3]); 
%3d n > settings->camera_dTstance[CAM_l ]) ; 
%3d" , settings->camera_di stance[CAM_2] ) ; 
%3d", sett ings->camera_di stance [CAM_3] ) ; 
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} 



printf("\n Apple Travel Interval: 
printf("\n Frame Time Interval: 
printf("\n 30-demo command: 



%3d" , settings->apple_travel_time_interval ) ; 
%3d" , settings->frame_time interval ) ; 
56s" , settings->demo_f iTe_command) ; 



compute_index(st, end_pos) 
{ 

int sum; 

for ( ; *st « ' 1 || 
for (*end pos » 0, sum « 0 
*st && *st !=''&& *st ! 



char *st; int *end_pos; 
st == '\f ; ++st); 



if (*st =« 1 :') ++*end_pos; 
return(sum) ; 



&& *st '\t' ; ++st, ++*end_pos) 
sum +« toupper(*st) ; 



char *st; 

char arg_v[MAX_ARGS] [NAMEMAX] ; 



separate_args ( st , arg_v ) 
{ 

int argc, i , sum; 
char c delimit; 

for (i - 0 ; i < MAX_ARG5 ; ++i) arg_v[i][0] =0; 

argc » 0; 

do { 
start: 

for ( ; isspace(*st) || (*st) -« ' : ' | | *st 0 ; ++st) { 

if (!(*st)) return(argc); } /* skip blanks */ 
/* check for comment */ 
if (* s t == ■/' && (*(st+l)} — '*') /* scan for end of comment */ 

{ do {.,... . " : 

++st; 

} wh'ile(!(*st == && (*(st+l)) — '/') && (*(st+l))); 
++st; If (*st == '/') ++st; 
goto start;) 

if (* s t — '/' i& *(st+l) == '/') break; /* C-h- comment */ 
while(isspace(*st)) ++st; 
c delimit - 0; 

if (*st « '"') c_delimit = ""; 

if (* s t — '\") c_delimit « '\*'; 

if (*st *\'') c_delimit = '\*'; 

if (c_delimit 1= 0) ( arg v[argc][0] = *st; ++st; 

for (i=l ; *st && i < NAMl_MAX && *st != cdelimit; ++st ) 

{ arg_v[argc][i] 

arg_v[argc] [i ] = c_delimit; ++i; 



) 

else { 
for (i=0 

) 



(!isspace(*st)) && *st && i < NAME_MAX; ++st ) 

{ arg_v[argc] [i] - *st 



while ( ! i sspace(*st) && *st ) ++st; 
arg_v[argc] [i] - 0; 
++argc; 

if (argc == MAX_ARGS) { fprintf (stderr , "Too Many Argumants"); 
return(argc); } 

} while(*st); 
return(argc) ; 

} 

ini t_program(prog_consts) 

struct prog settings *prog consts; 

( 

char tmp[32] ; 
int i ; 

Fdefine GREEN NAME "green" 
^define RED_NEME "red" 
^define IR NAME "ir n 
^define GRID NAME "grid" 



/* for final images 
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pdefine W_GREEN NAME "w_green" 

^define W_GRID RAME "w_grid" 

^define W_RED RAME "w_red" 

^define W IR RAME "w_ir" 

^define HOE RAME "hue" 

^define SATURNAHE "satur" 

^define VALUE NAME "value" 

#define BND_NAME "bnd" 

^define BND Z_NAME "bndz" 

^define NORM" FILE "norm" 

^define COLONS FILE "colors- 

^define SPOTSFlLE "spots" 

^define BRUIS FILE "bruis" 

^define STEM FILE "stem" 

^define PIP R FILE "pip h.bnd" 

^define SPLTTTER_LOCATlONS_MASTER_NAME "split" 

/* display coordinates for the images 

jfifdef DISPLAY 640 

prog consts->T_WIN_X_OFF[0] 
prog~consts->T WIN X 0FF[1] = "248"; 
prog~consts->T WIN X 0FF[2] - "444"; 



/* for image aquired f 



/* for hsv data */ 



"52"; prog_consts->T WIN Y OFF[0] - "30: ; 



#else 



tfendif 



prog consts->T_WlR_Y_OFF[l] - 
prog~consts->T_WIN_Y_0FF[2] 



'30" ; 
'30"; 



prog consts->T_WIN_X_OFF[0] = "10"; 
prog"consts->T WIN X OFF[l] = "10"; 
prog>onsts->T~WIN"X"OFF[2] - "10"; 

prog consts->stem_disp_x[0] = "30"; 
prog~consts->stem_disp_x[l] =« "30"; 
prog_consts->stem_disp_x[2] = "30"; 
prog_consts->color_disp_xlO] = "42"; 
prog_consts->color_disp_x[l] = "238" 
prog consts->color disp_x[2] = "434"; 



for li 

{ 



i < NUMBER OF CAMERAS 



prog consts->T WIN Y 0FF[0] -.MO"; 
prog"consts->T WIN Y 0FF[1} = "10"; 
prog~consts->T"WIN"Y30FF[23 = "10"; 

prog_consts->stem_di sp_y[0] » "300" 
prog_consts->stem_di sp_y [1] = "300" 
prog_consts->stem disp_y[2] - "300" 
prog_consts->color_disp_yl0] - "230" 
prog_consts->color_disp y[l] = "Z3Q n 
prog_consts->color_disp~y[2] » "230" 
M) 



sprintf(tmp > ,, %s.%ld", GREEN NAME, i); 

sprintf (tmp,"%s.%ld\ RED NAME, i); 

sprintf<tmp,"%s.%ld", I R NAME, i); 

sprintf(tmp,"%s.9£ld", GRID NAME, i); 

sprintf {tmp,"%s.%ld", W GRID NAME, i); 

sprintf(tmp f M %s.%]d", W_GREER NAME, i); 

sprintf<tmp,"*s.%ld\ W RED NAME, i); 

sprintf(tmp,"%s.%ld", W I R RAME, i); 

sprintf(tnp,"%s.%ld", H0E_RAME, i); 

sprintf(tmp,ns.%ld", SATURNAME, i); 

sprintf (tmp,"%s.%ld", VALUE_NAME, i); 

sprintf (tmp,"%s.%ld", BND_NAME, 1); 

sprintf<tmp,"%s.%ld", BND 2 NAME, i); 

sprintf (tmp,"%s.%ld\ C0LDR5 FILE, i); 

sprintf(tmp,"%s.Xld", SPOTS_FlLE, i); 

sprintf (tmp,"%s.%ld", BRUIS FILE , i); 

sprintf(tmp,"%s.%ld", STEM FILE , i); 

PIP H FILE , i); 



prog_consts->GREEN name[i] = strdup(tm 
prog_consts->RED_name[i ] = strdup(t 
prog_consts->IR_name[i] = strd 
prog_consts->GRID_name[i ] = strdup(tmp 

prog_consts->GRID W namefi] = 
prog_consts->GREEN_W_name"TiT = strdup( 
prog consts->RED_W_name[i] = s 
prog~consts->IR_W name[i] = st 
prog_consts->HUE name[ 
prog_consts->SATUR_name[T] = s 
prog consts->VALUE name[i] = s 
prog_consts->BND name[i7 = strdup(t 
prog_consts->BND 2 name[i] » strdup{ 
prog_consts->COLORS_7ile[i] - strdup(t 
prog_consts->SPOTS file[i] = s 
prog_consts->BRUISE file[iT - strdup(t 
prog_consts->STEM fTle[i] - strdup(tmp 
prog consts->PIP_H_f ile[i J » strdup(tm 



) 



sprintf(tmp,"%s.%ld 

sprintf (tmp, "%s%ld", SPLITTER LOCATl6NS_MASTER_NAME, i); 

prog consts->SPLITTER_LOCATIONS[i] = strdup(tmp); 



} 

static FILE *out_file; 

doubl e compute_vol ume { bndO , bnd 1 , bnd2 , camera_di stance) 
int *camera_di stance; 
struct boundary_data *bnd0,*bndl ,*bnd2; 

C int xl[N_CAMERAS], x2[N CAMERAS], y[N CAMERAS], x, i, xzl[N CAMERAS] ,xz2 [NCAMERAS] , 
size[3], diff [3],xllTN_CAMERAS] ; xlI[N_CAMERAS3,min_y,begTn_val=l; 
double volume, area; 
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float yheight ,min_height,z_3d[3j ; 
'° double compute line area(); 

if (Xsizeroj=bndO~>boundary_index) > (size[l]=bndl->boundary_index) ) 

min_y-l; 
else m1n_y=0; 
if ( (size[2]«bnd2->boundary_index) < size[min_y]) 
min_y=2 ; 

diff[ (min_y+2)%3]=size[ (min_y+2)%3]-size[rnin_y] ; 
15 if (<diff[(min y+l)%3}=size[ (rain_y+l)%3]-size[min y]) > SIZE BND DIFF LIMIT 

diff[(m"in_y+2)363] > SIZE_BND_DIFF_LIMIT) "{ * ~ 

printf("\n WARNING : Boundary structurs sizes are not similar "); 

} 

diff[m1n y]=0; 

for ( i=0 ; i < N CAMERAS ; i++) { 
if CsizeTi]=-0) continue; 
diff[i]/=2; 

20 3 

y heigh t={*camera_distance+{*(camera_di stance+l))+ 

(*(camera_distance+2)))*CCD_SIZE Y/( (float) CCD_RESQLUTION_Y*CAM_FO 
rnin_height— y height*size[min y]/2.; 

printf("\n y_fi-%5.3f min h=%5.3f cam_d_0=%d cam_d_2=%d" ,y_height,min_height, 
bndO->out_rect.yl=bndO -> bound"ary[begin_val+diff[0]] .y; 
bndl->out_rect .yl=bndl -> boundary[begin_val+diff[lJ].y; 
25 bnd2->out_rect ,yl=bnd2 -> boundary[begin_val+di ff [2] J .y ; 

volume = 0. ; 

/* Line loop exeqution & bnd z structur setting */ 
for (i = beginval; i < sizelmi n_y]-begin_val ; ++i) 

y[0] » bndO -> boundary[i+diff [0] ] .y; 
xl[0] = bndO -> boundaryfi+diff [0]].xl; 
x2[0] - bndO -> boundaryfi+diff [0] ].x2; 
y[l] = bndl -> boundaryfi+diff [ 1] ] .y; 
xl[l] = bndl -> boundary[i+diff[l]].xl; 
x2[l] - bndl -> boundary[i+diff[l]].x2; 
y[2] - bnd2 -> boundary[i+diff [2]] .y; 
xl[2] « bnd2 -> boundary[i+diff[2]] .xl; 
x2[2] - bnd2 -> boundaryfi+diff [2]] .x2; 

area-computel ine_area(xl, x2, camera_distance,xzl,xz2,xll,xl2) ; 
35 bndO -> boundary[i-beg i n val].y = y[0]; 

bndO -> boundaryti-beginval ] .xl = xzl[0]; 
bndO -> boundary[i-begin_val ] .x2 = xz2[0]; 
bndl -> boundaryf i-begin_val ] .y = y [ 1 ] ; 
bndl -> boundary[i-begin_val] .xl = xzlfl]; 
bndl -> boundary[i-begin_val ] .x2 = xz2[l]; 
bnd2 -> boundary [i-begin_val] .y « y[2]; 
bnd2 -> boundary[i-begin_val] .xl - xzl[2); 
bnd2 -> boundary [ i -begi n_val ] .x2 = xz2[2]; 
min_height+=y height; 
volume +- (double)area * (double)yheight; 

bnd0->out_rect.y2=bnd0 -> boundary[(~i )+diff [0]].y; 
bndl->out_rect .y2=bfidl -> boundaryf( — i )+diff [1]] .y; 
bnd2->out_rect.y2=bnd2 -> boundary [ (--i )+di ff [2] ] .y; 
45 bndO->boundary_index-bndl->boundary index»bnd2->boundary index=size[min y]-2*begin v 

printf("\n glb_all Volume:", ir %4d","cc", (int)(volume / 1000.)); ~ 
return (vol ume) ; 

} 

int do_simple_grade(spots, spt_index,Dark_Red,Siinple_red, Yellow, Green, Orange, apple size) 
struct spot spots[]; 
int apple size; 

„ long Dark Eed.Simple red, Yellow, Green, Orange; 



30 



40 



return( 1 ) ; 
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ID: 008. 
File name: app08.h 



V 

♦define _CFG 
♦define VGA 
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♦define wait sleep 

♦define f init_display finit_cfg 

♦define init_display init_cfg 

♦define INIT_DISPLAY init_cfg() 

♦define reinit_display reinit_cfg 

ffdefme copy_block (p, a, b,.c, d, e, f ) 
#def ine g"et_block (p, a, b, c, d, e, f ) 



ram_2_cfg<p, 0,0, (d)-(b), (c)-<a),e, f) 
cfg_2_ram{p, 0,0, (d)-(b), (c)-<a),e,f) 



#define clear_screen 
♦define pan^window 

♦define set_lut_active 
#define get_lut_values 

#define set_channel 
#define get_channel 



clear_screen_cfg 
pan_cfg 

load_output_lut_cfg 
read_output_lut_cfg 

set_color_channel_cfg 
g e t _co 1 o r_cha n n e l_c f g 



♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 
♦define 



write_str 
rpixel 
wpixel 
zoom^window 
rectangle 
f illed_rectangle 
f illed_rectangle_l 



dline 
init_grab 
cont_grab 
freese 
snap 



text_cfg 
rpixel_cfg 
wpixel_cfg 
zoora__cfg 
rectangle_cfg 

f illed_rectangle_cfg 
f illed_rectangle_cfg 



dline_cfg 
init_grab_cfg 
grab_cfg 
stopgrab_cfg 
snap_cfg 



set_line_writing_mode null_cfg 
move_abs move_abs_cfg 
draw_abs draw_abs__cf g 



♦define circle 
♦define f illed_circle 

♦define DRAW_ABS (a, b, c) 
♦define move ABS(a,b) 



circle_cfg 
filled_circle_cfg 

draw_abs ( (b) , (a) , (c) ) 
move_abs ((b), (a) > ; 



♦define MODE_SRC 
♦define ARROW 



50 



♦define 
♦define 



RED 

""green 
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♦define blue 2 

♦define FILLER 3 

♦define entire_depth iooo 

15 #ifndef PIXEL 

♦define PIXEL unsigned char 
♦endif 



struct cfg_data { 

int color_plar.e; 
2Q int pan; ~" 
int scroll; 
int zoom; 
} cf g_set tings ; 



#ifdef VGA 

#define DISPLAY_64G 

♦endif 



#define MAX_SPOTS 512 
# define MAX_FINAL_SPOTS 96 
# define IMG_ST_CA 10 
♦define REAL BLEMISH 11 



enum applejbrands { SMITH_TYPE - 0, HERMON_TYPE, ANAJTYPE, OR LEAN S_T YPE }; 

sdefine S_CALYX_GREEN_LOW 0 

#define S_CALYX_gresn_high 85 
#define S_CALYX_RED_LOW 0 

♦define S_CALYX_RED_H IGH 85 
♦define S_CALYX_IR_LON o 
♦define S_CALYX_IR HIGH 85 



♦define H_CALYX__GR£EN_LOW 0 

♦define H_CALYX_GREEN_HIGH 150 

fdefine K_CALYX_RED_LOW 0 

♦define H_CALYX_RED_HIGH 100 

•define K_CALYX_IR_LOK 0 

40 ♦define H_CALYX_IR_EIGH 55 

♦ define 0_CALYX_GR£EN_LOW 0 

♦define 0_CALYX_GREEN_HIGH 150 

♦define 0_CALYX_RED_LOW 0 

♦define 0_CALYX_RED_HIGB 100 

♦define G_CALYX_IR_LOW 0 

45 *define 0_CALYX_IR_HIGH 65 

♦define RUSSET_GREEN_LOW o 

♦define RUSSET_GREEN_HIGH 90 

♦define RUSSET_RED_LOW 0 

♦define RU S SE T_RED_H IGH 170 

♦define RUSSET_IR_L0K o 

♦define RUSSET IR HIGH 145 
50 ~ — 



55 



189 



EP 0 566 397 A2 



10 



20 



40 



45 



50 



55 



Mar 17 13:00 1993 app08.h Page 3 



4 define BRU I SE_GREEN_LOW 60 
Idefine BRUISE_GREEN_HIGH 110 
♦define BRUISE_RED_LOW 80 
15 t define BRUISE_RED_HIGH 120 

# define BRUISE_IR_L0W 120 
#define BRUISE_IR_HIGH 17 0 

#define GREEN_GREEN_LOW 85 

Sdefine GREEN_GR£EN_HIGH 130 
#define GREEN_RED_LOW 7 0 • 

#define green__red_high 120 

* define GREEN_TR_LOW 140 

fidefine GREEN IR HIGH 200 



#define RED_GRSEN_LOW 50 

tdefine red_green_high 90 

# define RED_RED_LOW 85 
^define RED_RED_HIGH 110 

25 #define RED_IR_LOW 140 

^define RED IR HIGH 180 



3 0 ^define T0P_VAL 200 

^define display^ eliminate display_image 

#define FILE_3D_NAME "glob. out" 

#define HEIGHT 165 

# define CALYX_MARK 2 00 

35 #define stem_mark calyx_kark 

#define CALYX_RUSSET_MARK 2 40 

^define RUSSET_MARK 150 

#define BRUSE_MARK 100 

#define WIRE_MAR* 254 

# define GREEN_MARK 50 

wdefine RED MARX 230 



#define S7ACK_CHECK if (stackavail {) < 512) < print f("\n COPSS"}; return (0); } 

#define FLOAT__ERROR 1 
fdefine NO PER 2 



^define MAX_EDGE_LEN (FR_X_SIZE * FR_Y_SIZE / sizeof (struct point)) 

#define LOW_mark 100 
#define KIGH_KARK 200 

^define MlN(a,b) ((a) < (b) ? (a) : (b) ) 
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#define MAX<a,b> ((a) > (b) ? (a) : (b) ) 
#define SGN(a) {(a) > 0 ? 1 : -1) 

♦define SGN_0(a> ((a) > 0 ? 1 : (<a) == 0 ? 0 : -1)> 

#define L_ON 1 
#define L_OFF 0 

^define wire_width 4 
#define EXTERNAL__COL0R 255 

#define l_fr_x_size 192 
#define L_FR_Y_SIZE 192 
#define FR_X_SIZE 14 4 
^define FR_Y_SIZE 144 

#define FR_HEADER_SIZE 512 
^define PIXELS unsigned char 
#define PIXEL unsigned char 
25 idefine SUCCESS i 

♦define FAILURE 0 
#define NO HEADER 10 



*define N_CAMERAS 3 

#define CAM_1 0 

#define CAM_2 1 

30 *define CAM 3 2 



15 



20 



♦define CCD_R£SOLUTION_X 640 
^define CCD_RESOLUTION_Y 480 



35 # define CAMERA_D I STANCE came ra_di stance 

♦define CCD_SI2E_X 6.4 
♦define CCD_SIZE_Y 4.8 

. #define CAM_focal length 12 



# define KAX__BOUNDARY 512 
40 struct line_pair { int y, xl, x2; }; 

struct rect { int xl, yl, x2, y2; \ ; 
struct point {int x, y; ); 
struct cam_data { 

struct line _paxr boundary [MAX__BOUNDARY] 
int boundary_index; 
struct rect out_rect; 
ar int camera distance ; 

In- 



struct two_d_data { 

signed char green_off_x, green_of f_y 

signed char red off x, red off v; 
50 _ ~ " ~* 
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signed char ir_off_x, ir_off_y; 
signed char grid_off_x, grid_off_y; 



15 



20 



25 
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#define CAM_ 1 _GRE EN_OF F_X 0 

♦ define C AM_ 1 _GRE E N_0 FF_Y C 

♦define CAM_l~RED_OFF_X 0 
♦define CAM_l_RED_OFF_Y 0 

♦define CAM_l_IR_OFF_X 0 

♦define Cam_1_ir_0FF_Y o 

♦define CAM_l_GRID_OFF_X 0 

♦define CAM1 GRID OFF Y 0 



♦define MAX_LENGTH 2048 
typedef struct const s_t i 
int min_area; 
int max_area ; 
int minjper; 
int max_per; 
int min_jp2a; 
int max_p2a; 
int min_aspect_ratio; 
int max_aspect_ratio; 
int min_fract; 
30 int max_fract; 

int magnification; 
int smooth; 
int step; 
int start_level; 
int end_level; 
int min__pile__depth; 
int max_pile_depth; 
float gaus — parameter_l; 
char screening_only; 
char use_area_absolute_val ; 
) contour_prog_globals; 



40 



♦define gtext_vga (x, y, s, sz, c, n) etextvga (x, <y-KL5) , s, 1, c, (sz) ) 

♦define gtext_demo etext_vga 
♦define init_di splay _demo reinit_vga 
♦define dline_demo vga_direct_line 

♦define display_image_demo (x, y, im r sx / sy, str) vga_put_image <im, sx, sy, x, y, str) 
♦define finit_vga restore_vga 
♦define f init_display_demo finit_vga - 
45 ♦define wpixel_demo vga_direct_wpixel 
♦define rectangle_demo vga_rectangle 
♦define f illed_rectangle_demo vga_f illed_rect angle 
♦define move_abs_demo vga_move abs 

♦define draw_abs_demo vga~draw~abs 
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#define VISITED 1 
#define NO_SPOT 200 
^define stem calyx 10 
15 #define RUSSET ING 100 
♦define BRUISE 17 0 

#define NUMBER_OF_CAKERA S 3 

*define SETUP_FILE M screen3d. set" 

2 Q struct setup_data { 

int camera_di stance ( NUMBER_OF_CAMERAS 3 ; 
int dac_low_lim[NUMBER_OF_CAMERASJ ; 
int dac_h^gh_l im ( NUM3E R_OF_C AMERA S ] ; 

int apple_travel_tiir.e_iriterval; 
int frame_time_i.nterval; 

25 char *demo_f ile_command; 

}/ 

struct prog_settings i 

char * GREEN_name [NUMBER_OF_CAMERAS 3 ; 
cha r * RED_name ( NUMBER_OF_CAMERAS ] ; 
ch a r * I R_n ame ( NUMBE R_OF_CAME RA S 3 ; 
char *GRID_name [NUMBER_OF_CAMERAS] ; 

char *GRID_w_narae[NUMBER_OF_CAMERAS] ; 
cha r * GREEN_W_n ame ( NUMSER_OF_CAMERAS ] ; 
Cha r * I R_W_n ame [ NUMB ER_OF_C AMERA S ) ; 
char *RE D_W_name [ NUMB£R_OF_CAME RAS ] ; 

35 Char " r GREEN_WIRES name {NUMBER_OF_CAMERAS J ; 

Char * I R_W I RE S_name [ NUMBER_OF_CAMERAS ] ; 
Char * RED_K IRE S_n ame [NUMBER_OF_CAMERAS ) ; 

char * BND_narae lNUMBER_OF_CAMERAS } ; 
char *BND_Z_name ( NUMBER_OF_CAMERAS ] ; 
char * CONORS file [I<v7I\EER OF CAMERAS] ; 
char *SPOTS_filelNUMBER_OF_CAMERASJ ; 
40 char *BRUISE_file [NUMBER_0F_CAM2RAS] ; 

char *STEM_filefNUMEER_OF_CAMERAS] ; 
char * P I P_H_f i 1 e [ numbe r_of_c amera s 3 ; 

char * HUE_name [ NUM3ER_OF_CAMERAS ] ; 
cha r * SATUR_name (NUMBER_OF_C AMERA S ] ; 
cha r * VALUE _name I NUMBER_OF_CAMERAS ] ; 



45 
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Char *T_WIN_X_OFF [ NUMBE R_OF_C AMERA S 3 ; 
Cha r * T_W IN_Y_OFF [ NUMBER_OF_CAMERA S J ; 
Char *SPLITTER_LOCATIONS[NUM3ER_OF_CAMERAS3 ; 



char * stem_disp_x [NUMBER_OF_CAMERAS 3 ; 
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cha r -st em_di sp_y ( NUMBER_OF_CAMERA S ] ; 
char -color_disp_x [ NUMBER_OF_camera S J ; 
char *color_disp_y [NUMBER_OF_cameraS] ; 

int came ra_di stance [ NUMBER_OF_CAMERAS ] ; 
i n t da c_l ow_l im [ NUM3ER_OF_CAMERA S ] ; 
int dac_high_lim f NUMBER_OF_CAMERAS 3 ; 

int apple_travel_time_interval; 
int frame_time interval; 



# define AUTO_MODE 1 
#define MAKUAL_MODE 2 

#define DIO_CLOCK_PERIOD 10 

#define DIO_BASE_ADDRESS 0x2A0 

# define DIO_BYTE0 <DIO_BASE_ADDRESS+0) 

fdefine dio_countero (Dio_base_address+4) 

#define DIO_COUNTERl (DIO_BASE_ADDRESS+5 ) 
♦define DIO CONTROL (DIO BASE ADDRESS+7) 



fdefine SI ZE_BND_DIFF_L IMI T 2 



fdefine ORLEANS_RED_THRESH 50 

# de f ine OR LEAN S_R_G_RAT 1 0_THR£ SH_A 2.22 

9 de f in e ORLEANS_R_G_RATI0_TRRE SH_B 1.81 

#define ORLEANS_R_G_RAT 1 0_THRE SH_C 1.54 



#define SMITH_RED_THRESH 60 

4define SMITH_R_G_RATIO_THRESH_A 2.22 

#define SMITH_R_G_RATIO_THRESH_B 1.71 

#define SMITH R G RATIO THRESH C 1.3 



grab_moving_apple (unsigned short, unsigned short, int); 

double angle_between {double, double, double, double, double, double, double *); 

^define STORAGE_F I LE "c : Wstorage . xms" 
^define SW7vP_OUT (buf, can, item) swap^out {buf , view_inf o [cam] . xms_handle, \ 

(unsigned long) sizeof (buf ) , view_info (com] . item) 
#define SWAP_OUT_SIZE (buf, cam, item, size) swap_out (buf , view_inf o (cam) .xms_handle, 

(unsigned long) size, view_info [cam] . item) 

#define SWAP_IN (buf , cam, item) swap_in (buf , view_info (camj . xms_handle, \ 

(unsigned long) sizeof (buf) , view_info [cam] . item) 
#define SWAP_IN_SIZE (buf , cam, item, size) swap_in(buf, view_info { cam] . xms_handle, 

(unsigned long) size, view_info team] . item) 



fdefine MAX_CAND IDA TE S 96 
struct c_dat { 

int si, sj, ci, ci, area, cam_number; 
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15 

} 



double ar, x, y, z, dist; 
int angle; 
int type; 
int mate; 



struct images_of fsets { 

unsigned long green; 
unsigned long red; 
unsigned long ir; 
20 unsigned long grid; 

) ; 

struct boundary_data { 

struct line_pair boundary [MAX_BOUNDARY J ; 
int boundary_index; 
struct rect out_rect; 

25 ,f 

struct single_view_info { 
int dim_l ; 
int dim_2; 
int angle; 
double volume; 

30 unsigned int xns_handle; 

unsigned long splitter [4]; 



35 



struct image s_o£ f 3ets w__images; 

struct images_of fsets r_images; 

struct images_of fsets raw_images; 

struct images_of fsets enhanced_images; 

3truct images_of fsets nonnal_images; 

unsigned long bnd; 
unsigned long bnd_z; 
unsigned long ref_bnd; 



unsigned long stem_mask; 
40 unsigned long spots_l; 

unsigned long spots_2; 
unsigned long spots__3; 
unsigned long combi_map; 
} ; 



45 

#define ORLEANS_GRID_TKRESH 4 0 

^define ORLEANS_RED_THRESH_LOW 0.40 

tdefine ORLEANS_RED_THRESH_MEDIUM 0.5 

♦define ORLEANS_RED_THRESH_HIGH 0.7 

50 #define ORLEANS_GREEN_THRESH_LOW o.3 0 
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•define 0RLEANS_GREEN_7HRSSH_MEDIUM 0.3 
♦define ORLEANS GREEN THRESH HIGH 0.4 



♦define SMITHJ3RID THRESH 

♦define SMITH_RED_THRESH_LOW 

♦define SMI TH_RED_T H RE SH_MED IUM 

♦define SMITH RED THRESH HIGH 



40 
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♦define SMITH_GREEN_THRESH_LOW 
♦define SMITH_GREEN_THRESH_MEDIUM 
♦define SMITH GREEN THRESH HIGH 



25 



* define 
♦define 
^define 
♦define 
♦define 



S IMP LE_RED_COLOR 
DARK_RED_COLOR 
ORANGE_COLOR 
GREEN_COLCR 
YELLOW COLOR 



♦define TMP DEVICE "d:" 



♦define LENGTH (x, y ) 
♦define PI 3.14159265358 



y) 



30 ♦define FR_HEADER_SIZE 512 

♦define CONTOUR_COL 255 
♦define BRUISE COLOR 254 



struct spotf 

unsigned char start_i, atart_j, ci, cj; 
35 unsigned char min_i, max_i, min_j, max_j; 

int area, per; 
float ar, p2a; 
unsigned char al, bl; 

unsigned char green_cgl, red_cgl, ir_cgl, grid_cgl; 
unsigned char g_ar_ir.ean, r_ar__mean, i_ar_mean, grid_ar_mean; 
unsigned char flagl, flag2, flag3, flag4, flag_g; 
unsigned char cair._number ; 
40 float x,y, z; 

float dist; 
int angle; 
int mate; 
} i 
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so_bruse_l (int cam, struct boundary_data *bnd,PIXEL imO {FR_Y_SIZE) [FR_X_SIZE] , 

PIXEL iml[FR_Y_SIZE) (FR_X SIZE], PIXEL im2 [FR_Y_SIZE] [FR_X 
PIXEL im3 (FR_Y_SIZEJ [FR_X~SIZEj , PIXEL im4 {FR_Y_SIZE] |FR X 
PIXEL im5 [FR_Y_SIZE] (FR_X_SIZEJ , 
struct spot spots 11] ); 

int cntr(PIXEL imO [FR_Y_SIZEHFR_X_SIZE] , PIXEL iml [FR_Y_SIZE] [FR_X_SIZE) , 

PIXEL im2 (FR_Y_SIZE)[FR_X_SIZE), PIXEL im3 [FR_Y_SIZE ] [FR X : 

int cam, PIXEL im4 [FR_Y_SIZE] [FR X_SIZE], 
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struct spot spots [J, 
PIXEL im6 [FR_Y_SIZEJ [FR_X_SI2E] ) ; 
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rem ID: Oil 
10 rem File name: build.bat 

rem also, create the f i ie screen3d .-ret, in ?Jiis appendix 
rem to run: at DOS prompt, type 'i_j.ild' 



del *.lib 

copy appOS.h adapter. h 

15 cl /AL /G2 /c /nologo /2i appOl.c 

cl /AL /G2 /c /nologo /Zi ap,c>03.c 

cl /AL /G2 /c /nologo /Zx app09.c 

cl /AL /G2 /c /nologo /Zi apvXO.C 
cl /AL /G2 /nologo /Zi appl2.c 

cl /AL >G2 /c /nologo /Zi tippl j .v 

cl /AL /G2 /c /nologo /Zi appl*l ': 

cl /AL /G2 /c ologc 'Zi cj.v?15.c 

cl /AL /G2 /c /.i^logo sli. aj-.v. 5.c 

cl /AL /G2 /c /nologo /Ki a pp. 1 . 7.c 



lib /nologo all + app"l; 
lib /nologo all + app~3; 
lib /nologo all + appO^r 
lib /nologo all + applG; 
25 lib /nologo all + app!2; 
lib /nologo all + appl4; 
lib /nologo all + appl3; 
lib /nologo all + appl6; 
lib /nologo all + appl7; :% 



: next 

link /ST:5000 /nologo appl5 , , , all+itxcf ginl+itxvspml+itxstbml ; > 1.1 

rem run the program 
applS Orleans o l > nul: 



35 rem Autoexec . be*, t 

set lib=c:\c600\lib 

set include=c:\c600\include 

PATH C:\C600\BINB;C:\C600\BIN;%path% 

SET HELPFI LES=C : \C600\HELP\* . HLP 

SET INIT=C:\C600\INIT 



rem Con fig . sys 

DEVICE=HIMEM.SYS /numhandles=16 

device— RAMDRIVE . SYS 7168 512 1024 /e 

SHELL=C:\DOS\COMMAND.COM C:\ /P /E:204 8 

BREAK =ON 

FILES=40 

BUFFERS=30 



45 rem Screen 3d. set 

grabber_low_dac_limit_R 65 

grabber_high_dac_limit_R 700 

grabber_low_dac_limit_G 6 5 

grabber_high_dac_limit_G 700 

grabber_low_dac_limit_B 70 

grabber__high_dac_limit_B 700 

qq apple_travel_interval 17 

frame_time_interval 66 

optical_distance_camera_l 7 20 

optica l_distance_camera_2 7 20 
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optical_distance_camera_3 7 20 

systera_command_3d_f ile MM 



10 Claims 

1. Apparatus for inspecting articles comprising: 
a camera; and 

a spectral filter defining a plurality of light paths from an article to be inspected to the camera, said 
15 plurality of light paths having different spectral characteristics, 

wherein said spectral filter comprises a prism operative to provide a plurality of images of the article 
having different spectral characteristics and being disposed in generally non-overlapping positions on an 
image plane of the camera. 

20 2. Apparatus for inspecting agricultural produce having a stem and a calyx comprising: 

a stem/calyx identifier for determining the locations of the stem and the calyx of the agricultural 
produce; and 

a blemish detector, cooperative with said stem/calyx detector, for detecting blemishes and avoiding 
false detections of the stem and calyx as blemishes. 

25 

3. Apparatus for inspecting articles comprising: 

an enclosure formed of a generally translucent light diffusing material; 
an external illuminator for illuminating said enclosure from the exterior thereof; 
an article driver for causing articles to be inspected to pass through said enclosure; and 
30 a camera for inspecting the articles as they pass through said enclosure. 

4. Apparatus for inspecting articles comprising: 

a camera operative to inspect generally all exposed surfaces of the article generally simultaneous- 
ly. 

35 5. Apparatus for inspecting agricultural produce substantially without bruising or squashing, comprising: 
a camera for inspecting delicate agricultural produce; 

a non-contact passage provider operative to provide substantially non-contact passage of said del- 
icate agricultural produce through the field of view of said camera; and 

a damper for receiving the delicate agricultural produce from said non-contact passage provider 
40 substantially without bruising or squashing the delicate agricultural produce. 

6. An agricultural produce inspection method comprising the steps of: 

inspecting a representation of an entity forming at least a portion of an agricultural product; and 
employing fuzzy logic criteria in order to classify the entity according to a predetermined classifi- 
es cation scheme. 

7. Apparatus for inspecting agricultural produce comprising: 

a produce labelling unit operative to associate an indication of at least one characteristic of an in- 
dividual item of agricultural produce with the item of produce; and 
50 a produce inspection unit operative to automatically inspect at least one characteristic of an indi- 

vidual item of produce and to provide an indication of the at least one characteristic to the produce labelling 
unit 

8. A singulator comprising: 

55 a conveyor configured and arranged to convey articles in sequence, 

characterized in that no element is provided to separate adjacently disposed articles along the con- 
veyor. 

9. A singulator comprising: 
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a conveyor configured and arranged to convey articles in sequence without controlling the distanc- 
es between adjacent article positions. 

10. A method for inspecting agricultural produce comprising the steps of: 

generating an image of individual agricultural products; and 

automatically grading agricultural products by receiving the image generated by the imager and 
providing an output indication of a grade for the individual agricultural product 

11. Apparatus for detecting blemishes on agricultural produce, the apparatus comprising: 

a dual IR illumination system operative to provide IR band I and IR band II illumination of the agri- 
cultural produce; and 

a sensor operative to receive first and second images of the agricultural produce as illuminated by 
the IR band I and IR band II illumination respectively; 

a comparison operator operative to compare the first and second images and to generate an output 
indication of blemishes, 

wherein the wavelength bands of the band I IR and band II IR illuminations are selected such that 
artifacts resembling blemishes are similarly detected by the two illuminations whereas blemishes are dif- 
ferently detected in the two illuminations. 

12. Conveying apparatus for agricultural produce comprising: 

a produce supporting cable assembly including a plurality of cables arranged to support agricultural 
produce. 
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FIG.19 
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READ INPUT FILES AND BOUNDARY 
COORDINATES 



SET PIXEL VALUE OUTSIDE OF THE 
BOUNDARY TO ZERO 



FOR EACH LINE INSIDE 
THE ARTICLE'S BOUNDARY: 



LOOP COMPLETION 



MARK GRADIENT PIXELS 



MEASURE INTERVALS BETWEEN 
HIGH GRADIENT POINTS 



FOR EACH INTERVAL, IF INTERVAL 
IS GREATER THAN A THRESHOLD, 
MARK THIS INTERVAL AS SUSPECT 



FOR EACH SUSPECT INTERVAL PIXEL 



LOOP 



MARK ALL COLOR COMPONENTS 
(IR, RED, GREEN) BELOW A 
BRIGHTNESS THRESHOLD 



FOR EACH MARKED SUSPECT INTERVAL PIXEL 



NO 



IF IT TOUCHES THE OUTER MARGINS 
OF THE FRUIT 



YES 



RECURSIVELY COUNT EVERY 
MARKED PIXEL THAT TOUCHES IT 



I 



IF MORE THAN FIVE PIXELS ARE MARKED, 
AND LESS THAN 460. REPORT A CALYX 
OR A STEM, SAVE MASK. 
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LOAD SET-UP 



LOAD APPLE VARIETY DATA 
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EACH CAMERA 
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GENERATE OPERATIVE OPTICAL CONDITIONS 



FOR EACH BLEMISH TYPE i 



IMAGE APPLE WITH BLEMISH TYPE i 



MANUALLY IDENTIFY BLEMISH LOCATION 
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